00000001:02000400:3.0F:1790895211.200382:0:2966:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_hostid 00000001:02000400:3.0:1790895227.986627:0:3185:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1790895230.205856:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 597 MB/s 00000001:01000000:1.0F:1790895230.456151:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 599 MB/s 00000001:01000000:2.0:1790895230.713747:0:3245:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3455 MB/s 00000020:02000000:3.0:1790895231.448973:0:3277:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_63_g3705aed 00000400:02000000:0.0F:1790895232.392180:0:3292:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.201.154@tcp [8/256/0/180] 00008000:02000000:1.0:1790895235.840382:0:3441:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1790895285.140479:0:5242:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1790895295.054366:0:5812:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790895295.054372:0:5812:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790895295.054514:0:5812:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005de8e5f8 00000080:02000400:1.0:1790895295.054525:0:5812:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1790895295.059265:0:5812:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1790895295.059282:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790895295.059328:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b2ae4b59) 00000020:00000080:1.0:1790895295.059351:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1790895295.094249:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1790895295.094781:0:5812:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1790895295.129756:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790895295.129798:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790895295.129819:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790895295.130408:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790895295.130520:0:5812:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790895295.131159:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790895295.131168:0:5812:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790895295.131181:0:5812:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf83a0 00000020:01000004:3.0:1790895295.131190:0:5812:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790895295.131194:0:5812:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790895295.131199:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005de8e5f8 from MGS 00000020:01000004:3.0:1790895295.131204:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790895295.131223:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000ff818fc6) 00000020:00000080:3.0:1790895295.131236:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790895295.131332:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005de8e5f8 from MGS, refs=2 00080000:01000000:3.0:1790895295.131338:0:5812:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790895295.131343:0:5812:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf83ae 00000100:00100000:3.0:1790895295.132114:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790895295.132261:0:5812:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790895295.132268:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1790895295.135023:0:5812:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1790895295.135036:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790895295.135710:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895295.135964:0:5812:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790895295.135970:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1790895295.136681:0:5812:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1790895295.136689:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790895295.137309:0:5812:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790895295.137319:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1790895295.141147:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895295.141156:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895295.141159:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895295.144378:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895295.144383:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895295.144385:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895295.155445:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1790895295.159227:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1790895295.408228:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2391 MB/s 00000001:01000000:0.0:1790895295.657956:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2415 MB/s 00000001:01000000:2.0:1790895295.908399:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 439 MB/s 00000001:01000000:2.0:1790895296.159289:0:5812:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 613 MB/s 00080000:10000000:2.0:1790895296.175428:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:3.0:1790895296.196528:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1790895296.196545:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1790895296.196557:0:5812:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790895296.206458:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790895296.206958:0:5812:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790895296.207034:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790895296.207332:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790895296.207360:0:5812:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790895296.207685:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895296.207842:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790895296.207849:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1790895296.214394:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1790895296.214406:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1790895296.219482:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1790895296.219500:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00010000:00010000:0.0:1790895296.219907:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790895296.220511:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1790895296.220535:0:5812:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.154@tcp' 00000020:01000004:2.0:1790895296.220537:0:5812:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1790895296.220587:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.154@tcp (typ=mgc) 00000020:00000080:2.0:1790895296.220607:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.154@tcp (0000000028c8b2de) 00000020:00000080:2.0:1790895296.220625:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1790895296.220733:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dc79120c@MGC192.168.201.154@tcp: add connection 192.168.201.154@tcp at head 00010000:00010000:2.0:1790895296.220918:0:5812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.154@tcp-0 is initialized 00000040:01000000:2.0:1790895296.220934:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 1 is initialized 10000000:01000000:3.0:1790895296.223393:0:5828:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790895296.223445:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.154@tcp (uuid 221ad158-1cb7-4652-832e-1e3667184cca) 00000020:00000080:3.0:1790895296.223468:0:5812:0:(genops.c:1384:class_connect()) connect: client 221ad158-1cb7-4652-832e-1e3667184cca, cookie 0x7911a98710cf83bc 00000100:00080000:3.0:1790895296.223481:0:5812:0:(import.c:545:import_select_connection()) MGC192.168.201.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790895296.223491:0:5812:0:(import.c:666:import_select_connection()) MGC192.168.201.154@tcp: import 00000000dc79120c using connection 192.168.201.154@tcp/0@lo 00000100:00100000:3.0:1790895296.223548:0:5812:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009978d1c6 x1877889758789760/t0(0) o250->MGC192.168.201.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790895296.223675:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009978d1c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:221ad158-1cb7-4652-832e-1e3667184cca:3307:1877889758789760:0@lo:250: 00000100:00100000:3.0:1790895296.223770:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790895296.223828:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 221ad158-1cb7-4652-832e-1e3667184cca->MGS 00000020:01000004:3.0:1790895296.223851:0:5812:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790895296.223905:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790895296.223918:0:5812:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000a77e05cd) 00000020:00000080:3.0:1790895296.223946:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790895296.225346:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758789760 00000100:00100000:0.0:1790895296.225359:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758789760 00000100:00100000:0.0:1790895296.225403:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895296.225410:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000006cc817a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1877889758789760:12345-0@lo:250: 00010000:00080000:0.0:1790895296.225436:0:5824:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 221ad158-1cb7-4652-832e-1e3667184cca@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:0.0:1790895296.225473:0:5824:0:(genops.c:1384:class_connect()) connect: client 221ad158-1cb7-4652-832e-1e3667184cca, cookie 0x7911a98710cf83ca 00000100:00080000:0.0:1790895296.225613:0:5824:0:(import.c:65:import_set_state_nolock()) 0000000068d44eea : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895296.225707:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000006cc817a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+5:3307:x1877889758789760:12345-0@lo:250: Request processed in 296us (1937us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895296.225715:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790895296.225826:0:5827:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1790895296.227741:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790895296.227756:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.154@tcp: connect to target with instance 0 00000100:00080000:0.0:1790895296.227764:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790895296.227770:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790895296.227773:0:3307:0:(import.c:65:import_set_state_nolock()) 00000000dc79120c MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790895296.227777:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790895296.227789:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790895296.227797:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009978d1c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:221ad158-1cb7-4652-832e-1e3667184cca:3307:1877889758789760:0@lo:250: 00000100:00100000:1.0:1790895296.266418:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895296.266629:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790895296.266635:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790895296.273044:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790895296.273071:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1790895296.273601:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1790895296.273608:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1790895296.274339:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790895296.274527:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1790895296.274533:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1790895296.275620:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1790895296.275628:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790895296.314840:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895296.315081:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790895296.315089:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790895296.325083:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790895296.325104:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790895296.326252:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895296.326489:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790895296.326497:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790895296.327685:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790895296.327702:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790895296.328644:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895296.328819:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790895296.328824:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790895296.330000:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790895296.330012:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790895296.330758:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895296.331135:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790895296.331141:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790895296.332500:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790895296.332577:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790895296.362656:0:5812:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895296.363076:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790895296.363084:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790895296.365589:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790895296.365604:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790895296.368142:0:5812:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790895296.368159:0:5812:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790895296.368792:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790895296.368811:0:5812:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790895296.368816:0:5812:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1790895296.369050:0:5812:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790895296.369258:0:5812:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.154@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1790895296.369261:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790895296.369324:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790895296.369326:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895296.369327:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895296.369328:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895296.369335:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895296.369336:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790895296.369337:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790895296.369339:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895296.369340:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895296.369341:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895296.369343:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790895296.369345:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1790895296.369347:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790895296.369348:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790895296.369349:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895296.369350:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895296.369351:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895296.369352:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895296.369353:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790895296.369353:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790895296.369354:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895296.369355:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895296.369355:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895296.369356:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790895296.369389:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1790895296.369405:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010c716ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758789888:0@lo:253: 00000100:00100000:0.0:1790895296.369488:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895296.369544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758789888 00000100:00100000:1.0:1790895296.369555:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758789888 00000100:00100000:0.0:1790895296.369557:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 000000000aff5c65 going to sleep for 11 seconds 00000100:00100000:1.0:1790895296.369758:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895296.369768:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b8d45ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+5:5812:x1877889758789888:12345-0@lo:253: 20000000:01000000:1.0:1790895296.369813:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790895296.369816:0:5826:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1790895296.371027:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790895296.371085:0:5826:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1790895296.371721:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790895296.374416:0:5848:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1790895296.374562:0:5826:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790895296.374568:0:5826:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1790895296.374574:0:5826:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1790895296.374577:0:5826:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1790895296.374595:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1790895296.374838:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790895296.375116:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1790895296.375130:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790895296.375192:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1790895296.375255:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1790895296.375552:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1790895296.375653:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1790895296.375662:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1790895296.375720:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1790895296.375728:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1790895296.375759:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1790895296.375766:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1790895296.375797:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1790895296.375846:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1790895296.375905:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1790895296.375910:0:5826:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1790895296.375934:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790895296.376117:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1790895296.376127:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790895296.376161:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1790895296.376192:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1790895296.376234:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1790895296.376245:0:5826:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1790895296.376393:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1790895296.376403:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790895296.376474:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1790895296.376519:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1790895296.376559:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1790895296.376571:0:5826:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1790895296.376677:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1790895296.376687:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1790895296.376722:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1790895296.376761:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1790895296.376983:0:5826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1790895296.377034:0:5826:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1790895296.377041:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1790895296.377737:0:5849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1790895296.378157:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1790895296.378187:0:5826:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.154@tcp for mdt 20000000:01000000:0.0:1790895296.378189:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:0.0:1790895296.378226:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1790895296.378242:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1790895296.378347:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1790895296.378355:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:0.0:1790895296.378407:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1790895296.378419:0:5826:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1790895296.378452:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1790895296.378489:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1790895296.378553:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790895296.378557:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1790895296.378562:0:5826:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1790895296.378568:0:5826:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1790895296.378998:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1790895296.379139:0:5826:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1790895296.386601:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1790895296.386659:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1790895296.386736:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1790895296.386758:0:5826:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790895296.386761:0:5826:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790895296.386765:0:5826:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790895296.386808:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790895296.386812:0:5826:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790895296.386843:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790895296.386845:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790895296.390754:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1790895296.394170:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1790895296.394517:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1790895296.394601:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1790895296.394622:0:5826:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790895296.394625:0:5826:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1790895296.396154:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1790895296.396652:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1790895296.396715:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1790895296.396754:0:5826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1790895296.396777:0:5826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1790895296.396779:0:5826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1790895296.396786:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790895296.396807:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.396824:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.396834:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.396841:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.396847:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.397399:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.397473:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ccb9cd4 already unused, calling callback (00000000ab926ebc) 00010000:00010000:0.0:1790895296.397477:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.397485:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.397497:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.397504:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.397525:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ccb9cd4/0x7911a98710cf83d1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790895296.397542:0:5826:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790895296.703340:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b8d45ef8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+5:5812:x1877889758789888:12345-0@lo:253: Request processed in 333566us (333843us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895296.703360:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790895296.703680:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010c716ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758789888:0@lo:253: 10000000:01000000:0.0:1790895296.703696:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1790895296.703699:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790895296.703701:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1790895296.703703:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895296.703704:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1790895296.703705:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895296.703706:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895296.703707:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1790895296.703709:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1790895296.703710:0:5812:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1790895296.703711:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895296.703712:0:5812:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790895296.703730:0:5812:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005de8e5f8 from lustre-MDT0000 10000000:01000000:0.0:1790895296.703754:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1790895296.703756:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1790895296.703760:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cf3031ab380 10000000:01000000:0.0:1790895296.703764:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1790895296.703771:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf3031ab380 from 1 10000000:01000000:0.0:1790895296.703774:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790895296.703811:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 000000003ccb9cd4/0x7911a98710cf83d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.703821:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 000000003ccb9cd4/0x7911a98710cf83d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.703830:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 000000003ccb9cd4/0x7911a98710cf83d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895296.703906:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000010c716ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790016:0@lo:101: 00000100:00100000:0.0:1790895296.703956:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895296.704002:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000af2cd08c going to sleep for 11 seconds 00000100:00100000:1.0:1790895296.704185:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790016 00000100:00100000:1.0:1790895296.704192:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790016 00000100:00100000:1.0:1790895296.704235:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790895296.704243:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c833748a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+5:5812:x1877889758790016:12345-0@lo:101: 00010000:00010000:1.0:1790895296.704256:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895296.704269:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008859f19e/0x7911a98710cf83df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf83d8 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895296.704290:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008859f19e/0x7911a98710cf83df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895296.704299:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008859f19e/0x7911a98710cf83df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895296.704307:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008859f19e, rc 0) 00000100:00100000:1.0:1790895296.704349:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c833748a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+6:5812:x1877889758790016:12345-0@lo:101: Request processed in 107us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895296.704355:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790895296.704438:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000010c716ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790016:0@lo:101: 00010000:00010000:3.0:1790895296.704451:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 000000003ccb9cd4/0x7911a98710cf83d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.704458:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 000000003ccb9cd4/0x7911a98710cf83d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895296.704522:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790144:0@lo:501: 00000100:00100000:3.0:1790895296.704667:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895296.704691:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055726f94 going to sleep for 11 seconds 00000100:00100000:1.0:1790895296.704751:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790144 00000100:00100000:1.0:1790895296.704756:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790144 00000100:00100000:1.0:1790895296.704787:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790895296.704793:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002a4e4a57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+6:5812:x1877889758790144:12345-0@lo:501: 00000100:00100000:1.0:1790895296.705033:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002a4e4a57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+6:5812:x1877889758790144:12345-0@lo:501: Request processed in 240us (366us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790895296.705041:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790895296.705182:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790144:0@lo:501: 10000000:01000000:3.0:1790895296.705209:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790895296.705230:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 000000003ccb9cd4/0x7911a98710cf83d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.705239:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 000000003ccb9cd4/0x7911a98710cf83d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895296.705247:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf303072000 10000000:01000000:3.0:1790895296.705252:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1790895296.705255:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cf303072000 10000000:01000000:3.0:1790895296.705257:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1790895296.705260:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cf303072000 from 1 10000000:01000000:3.0:1790895296.705263:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1790895296.705286:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000dac0d6b6/0x7911a98710cf83e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.705293:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000dac0d6b6/0x7911a98710cf83e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.705300:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000dac0d6b6/0x7911a98710cf83e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895296.705312:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790272:0@lo:101: 00000100:00100000:3.0:1790895296.705347:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895296.705375:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055726f94 going to sleep for 11 seconds 00000100:00100000:1.0:1790895296.705798:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790272 00000100:00100000:1.0:1790895296.705805:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790272 00000100:00100000:1.0:1790895296.705972:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790895296.705979:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000dda353ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+6:5812:x1877889758790272:12345-0@lo:101: 00010000:00010000:1.0:1790895296.705990:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895296.706002:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004eb2f02d/0x7911a98710cf83ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf83e6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895296.706022:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004eb2f02d/0x7911a98710cf83ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf83e6 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895296.706030:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004eb2f02d/0x7911a98710cf83ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf83e6 expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895296.706036:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004eb2f02d, rc 0) 00000100:00100000:1.0:1790895296.706080:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000dda353ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+7:5812:x1877889758790272:12345-0@lo:101: Request processed in 102us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895296.706087:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790895296.706222:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790272:0@lo:101: 00010000:00010000:3.0:1790895296.706234:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000dac0d6b6/0x7911a98710cf83e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.706241:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000dac0d6b6/0x7911a98710cf83e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895296.706253:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790895296.706271:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000dac0d6b6/0x7911a98710cf83e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.706277:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000dac0d6b6/0x7911a98710cf83e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895296.706282:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790895296.706286:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790895296.706290:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cf303072000 10000000:01000000:3.0:1790895296.706292:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790895296.706295:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790895296.706297:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790895296.706312:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000fc546430/0x7911a98710cf83f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.706318:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000fc546430/0x7911a98710cf83f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.706324:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000fc546430/0x7911a98710cf83f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895296.706345:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790400:0@lo:101: 00000100:00100000:3.0:1790895296.706372:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895296.706667:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055726f94 going to sleep for 11 seconds 00000100:00100000:0.0:1790895296.706769:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790400 00000100:00100000:0.0:1790895296.706776:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790400 00000100:00100000:0.0:1790895296.706808:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790895296.706813:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000034e67f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+7:5812:x1877889758790400:12345-0@lo:101: 00010000:00010000:0.0:1790895296.706823:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895296.706833:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000be17e713/0x7911a98710cf83fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf83f4 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.706848:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000be17e713/0x7911a98710cf83fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.706887:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000be17e713/0x7911a98710cf83fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895296.706895:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000be17e713, rc 0) 00000100:00100000:0.0:1790895296.706939:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000034e67f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+8:5812:x1877889758790400:12345-0@lo:101: Request processed in 126us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895296.706945:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790895296.707024:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790400:0@lo:101: 00010000:00010000:3.0:1790895296.707036:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000fc546430/0x7911a98710cf83f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895296.707042:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000fc546430/0x7911a98710cf83f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895296.707086:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790528:0@lo:501: 00000100:00100000:3.0:1790895296.707111:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895296.707141:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055726f94 going to sleep for 11 seconds 00000100:00100000:0.0:1790895296.707192:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790528 00000100:00100000:0.0:1790895296.707196:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790528 00000100:00100000:0.0:1790895296.707214:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790895296.707219:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000026d19d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+8:5812:x1877889758790528:12345-0@lo:501: 00000100:00100000:0.0:1790895296.707455:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000026d19d43 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+9:5812:x1877889758790528:12345-0@lo:501: Request processed in 235us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895296.707471:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895296.707553:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790528:0@lo:501: 00000100:00100000:3.0:1790895296.707578:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790656:0@lo:503: 00000100:00100000:3.0:1790895296.707615:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895296.707637:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 0000000055726f94 going to sleep for 11 seconds 00000100:00100000:0.0:1790895296.707760:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790656 00000100:00100000:0.0:1790895296.707764:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790656 00000100:00100000:0.0:1790895296.707782:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790895296.707787:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e80589a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+9:5812:x1877889758790656:12345-0@lo:503: 00000100:00100000:0.0:1790895296.707975:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e80589a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+9:5812:x1877889758790656:12345-0@lo:503: Request processed in 187us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895296.707981:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790895296.708120:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758790656:0@lo:503: 00000100:00100000:3.0:1790895296.708481:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5855:1877889758790784:0@lo:502: 00000100:00100000:3.0:1790895296.708517:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895296.708724:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000dc564284 going to sleep for 11 seconds 00000100:00100000:1.0:1790895296.708787:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790784 00000100:00100000:1.0:1790895296.708794:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790784 00000100:00100000:0.0:1790895296.708844:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790895296.708853:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007b51776d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+9:5855:x1877889758790784:12345-0@lo:502: 00000100:00100000:0.0:1790895296.709055:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007b51776d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+9:5855:x1877889758790784:12345-0@lo:502: Request processed in 203us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895296.709062:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790895296.709151:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5855:1877889758790784:0@lo:502: 00000020:01000000:3.0:1790895296.709176:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895296.709187:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895296.709195:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790895296.709203:0:5855:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1790895296.709206:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790895296.709219:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000ad63b2a4) 00000020:00000080:3.0:1790895296.709238:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1790895296.709244:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1790895296.709314:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:3.0:1790895296.709321:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf8409 00000020:00000080:3.0:1790895296.709575:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1790895296.709581:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895296.709585:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895296.709586:0:5855:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1790895296.709589:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895296.709592:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895296.709593:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1790895296.709596:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790895296.709602:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000d3e8b3f4) 00000020:00000080:3.0:1790895296.709611:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1790895296.709615:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1790895296.709616:0:5855:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1790895296.709619:0:5855:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1790895296.709624:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790895296.709665:0:5855:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005de8e5f8 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1790895296.709682:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (0000000002faebf9) 00000020:00000080:3.0:1790895296.709689:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1790895296.709745:0:5855:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1790895296.709750:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf841e 00000020:00000080:3.0:1790895296.709841:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1790895296.709846:0:5855:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1790895296.709851:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7911a98710cf8425 00080000:01000000:3.0:1790895296.709855:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:3.0:1790895296.709898:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf842c 00080000:10000000:3.0:1790895296.710278:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1790895296.710471:0:5855:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1790895296.712796:0:5855:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1790895296.836189:0:5855:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1790895296.837107:0:5855:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1790895296.841623:0:5855:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1790895296.842031:0:5855:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1790895296.897804:0:5855:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001e7d2326) 00000020:00000080:0.0:1790895296.897830:0:5855:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1790895296.897979:0:5855:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1790895296.897987:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf843a 00000020:00000080:0.0:1790895296.903191:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1790895296.907273:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1790895296.960061:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790895297.014712:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790895297.083051:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790895297.175739:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1790895297.240968:0:5855:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1790895297.241415:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790895297.287321:0:5855:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7911a98710cf8441 00000020:00000080:1.0:1790895297.289506:0:5855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1790895297.289520:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895297.289527:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895297.289530:0:5855:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1790895297.289533:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895297.289539:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895297.289549:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1790895297.289555:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1790895297.289604:0:5855:0:(mdt_lproc.c:338:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1790895297.289621:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895297.289625:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895297.289626:0:5855:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1790895297.289628:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895297.289631:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895297.289632:0:5855:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790895297.289635:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790895297.289636:0:5855:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1790895297.289695:0:5855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4047500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5855:1877889758790912:0@lo:502: 00000100:00100000:1.0:1790895297.289785:0:5855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895297.289836:0:5855:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ec1ec435 going to sleep for 11 seconds 00000100:00100000:3.0:1790895297.289954:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758790912 00000100:00100000:3.0:1790895297.289962:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758790912 00000100:00100000:3.0:1790895297.290012:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790895297.290021:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000028037df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+9:5855:x1877889758790912:12345-0@lo:502: 00000100:00100000:3.0:1790895297.290354:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000028037df9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+9:5855:x1877889758790912:12345-0@lo:502: Request processed in 334us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895297.290362:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790895297.290737:0:5855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4047500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5855:1877889758790912:0@lo:502: 00000020:01000000:1.0:1790895297.290768:0:5855:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895297.290775:0:5855:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895297.290777:0:5855:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790895297.290781:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1790895297.291098:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1790895297.291115:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790895297.291137:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000fc546430/0x7911a98710cf83f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.291148:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000fc546430/0x7911a98710cf83f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895297.291156:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf303072000 from 1 10000000:01000000:3.0:1790895297.291158:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790895297.291187:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.291193:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.291201:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895297.291225:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791040:0@lo:101: 00000100:00100000:3.0:1790895297.291262:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895297.291287:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b9141f3 going to sleep for 11 seconds 00000100:00100000:1.0:1790895297.291357:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791040 00000100:00100000:1.0:1790895297.291363:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791040 00000100:00100000:1.0:1790895297.291466:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790895297.291474:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000019a554c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+9:5812:x1877889758791040:12345-0@lo:101: 00010000:00010000:1.0:1790895297.291485:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895297.291499:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8448 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.291520:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8448 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.291530:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8448 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.291545:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000173077e5, rc 0) 00000100:00100000:1.0:1790895297.291581:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000019a554c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+10:5812:x1877889758791040:12345-0@lo:101: Request processed in 107us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895297.291587:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790895297.291623:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006bd1fc28 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791040:0@lo:101: 00010000:00010000:1.0:1790895297.291634:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.291642:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895297.292224:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e4047500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791168:0@lo:256: 00000100:00100000:1.0:1790895297.292266:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895297.292283:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000452a0f04 going to sleep for 11 seconds 00000100:00100000:1.0:1790895297.292302:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791168 00000100:00100000:1.0:1790895297.292307:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791168 00000100:00100000:1.0:1790895297.292332:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790895297.292338:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b0172c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+10:5812:x1877889758791168:12345-0@lo:256: 20000000:01000000:1.0:1790895297.292353:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1790895297.292375:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1790895297.292676:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b0172c60 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+10:5812:x1877889758791168:12345-0@lo:256: Request processed in 337us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895297.292684:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790895297.293841:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e4047500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791168:0@lo:256: 10000000:01000000:3.0:1790895297.294605:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790895297.294675:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.294687:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895297.294695:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf303072000 from 1 10000000:01000000:3.0:1790895297.294697:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790895297.294733:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.294740:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.294747:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895297.294766:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000964f31c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791296:0@lo:101: 00000100:00100000:3.0:1790895297.294814:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895297.294854:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 000000005b9141f3 going to sleep for 11 seconds 00000100:00100000:2.0:1790895297.295015:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791296 00000100:00100000:2.0:1790895297.295033:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791296 00000100:00100000:2.0:1790895297.295083:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895297.295092:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d0dd106f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+10:5812:x1877889758791296:12345-0@lo:101: 00010000:00010000:2.0:1790895297.295104:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895297.295119:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8456 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895297.295138:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8456 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895297.295148:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8456 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895297.295155:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bdef898d, rc 0) 00000100:00100000:2.0:1790895297.295205:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d0dd106f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:5812:x1877889758791296:12345-0@lo:101: Request processed in 114us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895297.295211:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1790895297.295293:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000964f31c5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791296:0@lo:101: 00010000:00010000:0.0:1790895297.295306:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.295314:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895297.295361:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f90a6fb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791424:0@lo:501: 00000100:00100000:0.0:1790895297.295462:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895297.295492:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 000000006c410538 going to sleep for 11 seconds 00000100:00100000:2.0:1790895297.295544:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791424 00000100:00100000:2.0:1790895297.295549:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791424 00000100:00100000:2.0:1790895297.295578:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790895297.295583:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000001762d865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:5812:x1877889758791424:12345-0@lo:501: 00000100:00100000:2.0:1790895297.296081:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000001762d865 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:5812:x1877889758791424:12345-0@lo:501: Request processed in 498us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895297.296089:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790895297.296150:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f90a6fb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791424:0@lo:501: 00000100:00100000:2.0:1790895297.296194:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791552:0@lo:503: 00000100:00100000:2.0:1790895297.296232:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895297.296252:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab521b50 going to sleep for 11 seconds 00000100:00100000:2.0:1790895297.296271:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791552 00000100:00100000:2.0:1790895297.296275:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791552 00000100:00100000:2.0:1790895297.296295:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790895297.296301:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c707ba65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:5812:x1877889758791552:12345-0@lo:503: 00000040:00080000:2.0:1790895297.296334:0:5826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790895297.296370:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c707ba65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:5812:x1877889758791552:12345-0@lo:503: Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895297.296376:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790895297.296583:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791552:0@lo:503: 00000040:00080000:3.0:1790895297.297697:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1790895297.298149:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1790895297.298170:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895297.298192:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895297.298204:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895297.298303:0:5812:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790895297.298316:0:5812:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf303072000 10000000:01000000:3.0:1790895297.298319:0:5812:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf303072000 10000000:01000000:3.0:1790895297.298323:0:5812:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790895297.298329:0:5812:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf303072000 from 1 10000000:01000000:3.0:1790895297.298332:0:5812:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895297.298364:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 0000000074f05b6d/0x7911a98710cf8464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.298372:0:5812:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 0000000074f05b6d/0x7911a98710cf8464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.298380:0:5812:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 0000000074f05b6d/0x7911a98710cf8464 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895297.298467:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000937fdc20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791680:0@lo:101: 00000100:00100000:3.0:1790895297.298526:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895297.298566:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a847d9f9 going to sleep for 11 seconds 00000100:00100000:0.0:1790895297.298627:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791680 00000100:00100000:0.0:1790895297.298635:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791680 00000100:00100000:0.0:1790895297.298677:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790895297.298685:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e414960c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:5812:x1877889758791680:12345-0@lo:101: 00010000:00010000:0.0:1790895297.298697:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895297.298709:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000028976300/0x7911a98710cf846b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8464 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.298731:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000028976300/0x7911a98710cf846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8464 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.298741:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000028976300/0x7911a98710cf846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8464 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.298750:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000028976300, rc 0) 00000100:00100000:0.0:1790895297.298796:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e414960c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:5812:x1877889758791680:12345-0@lo:101: Request processed in 112us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895297.298803:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790895297.298965:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000937fdc20 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791680:0@lo:101: 00010000:00010000:2.0:1790895297.298979:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 0000000074f05b6d/0x7911a98710cf8464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895297.298987:0:5812:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 0000000074f05b6d/0x7911a98710cf8464 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895297.299035:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791808:0@lo:501: 00000100:00100000:2.0:1790895297.299060:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895297.299090:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab521b50 going to sleep for 11 seconds 00000100:00100000:3.0:1790895297.299167:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791808 00000100:00100000:3.0:1790895297.299172:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791808 00000100:00100000:3.0:1790895297.299202:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790895297.299207:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c897d26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:5812:x1877889758791808:12345-0@lo:501: 00000100:00100000:3.0:1790895297.299584:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c897d26b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:5812:x1877889758791808:12345-0@lo:501: Request processed in 376us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895297.299592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790895297.299660:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791808:0@lo:501: 00000100:00100000:2.0:1790895297.299695:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791936:0@lo:503: 00000100:00100000:2.0:1790895297.299731:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895297.299780:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ab521b50 going to sleep for 11 seconds 00000100:00100000:3.0:1790895297.300009:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758791936 00000100:00100000:3.0:1790895297.300015:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758791936 00000100:00100000:3.0:1790895297.300084:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790895297.300091:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f2c414d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5812:x1877889758791936:12345-0@lo:503: 00000100:00100000:2.0:1790895297.300486:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758791936:0@lo:503: 00000100:00100000:2.0:1790895297.300796:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5860:1877889758792064:0@lo:502: 00000100:00100000:2.0:1790895297.300835:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895297.300885:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f2c414d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5812:x1877889758791936:12345-0@lo:503: Request processed in 767us (1126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895297.300899:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790895297.301065:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 000000009559a367 going to sleep for 11 seconds 00000100:00100000:3.0:1790895297.301143:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792064 00000100:00100000:3.0:1790895297.301148:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792064 00000100:00100000:3.0:1790895297.301166:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790895297.301172:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ed10d9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5860:x1877889758792064:12345-0@lo:502: 00000100:00100000:3.0:1790895297.301374:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ed10d9e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5860:x1877889758792064:12345-0@lo:502: Request processed in 202us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895297.301381:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790895297.301510:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5860:1877889758792064:0@lo:502: 00000020:01000004:2.0:1790895297.301563:0:5860:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1790895297.301576:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000291fefdf) 00000020:00000080:2.0:1790895297.301595:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1790895297.301685:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005de8e5f8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790895297.301688:0:5860:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005de8e5f8 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1790895297.301691:0:5860:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005de8e5f8 4 00010000:00080000:2.0:1790895297.301720:0:5860:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009a739956@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:2.0:1790895297.303737:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1790895297.303983:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1790895297.304015:0:5860:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790895297.304025:0:5860:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7911a98710cf8479 00000100:00080000:2.0:1790895297.304034:0:5860:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790895297.304041:0:5860:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009a739956 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895297.304074:0:5860:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000653f1260 x1877889758792192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895297.304105:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758792192:0@lo:38: 00000100:00100000:2.0:1790895297.304176:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895297.304241:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792192 00000100:00100000:2.0:1790895297.304254:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792192 00000100:00100000:2.0:1790895297.304285:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895297.304291:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000020e34a63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1877889758792192:12345-0@lo:38: 00000100:00100000:2.0:1790895297.304342:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000020e34a63 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1877889758792192:12345-0@lo:38: Request processed in 50us (166us total) trans 0 rc -11/-11 00000100:00100000:2.0:1790895297.304348:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895297.304383:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790895297.304390:0:3307:0:(import.c:65:import_set_state_nolock()) 000000009a739956 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790895297.307985:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790895297.307994:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758792192:0@lo:38: 00000100:00080000:2.0:1790895297.308050:0:5860:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790895297.308694:0:5860:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5860:1877889758792320:0@lo:502: 00000100:00100000:2.0:1790895297.308774:0:5860:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895297.308814:0:5860:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d13ef7e5 going to sleep for 11 seconds 00000100:00100000:2.0:1790895297.308835:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792320 00000100:00100000:2.0:1790895297.308842:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792320 00000100:00100000:2.0:1790895297.308911:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790895297.308920:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b2d2c8f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5860:x1877889758792320:12345-0@lo:502: 00000100:00100000:2.0:1790895297.309141:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b2d2c8f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5860:x1877889758792320:12345-0@lo:502: Request processed in 222us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895297.309149:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790895297.309210:0:5860:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:5860:1877889758792320:0@lo:502: 00000040:00080000:2.0:1790895297.309236:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1790895297.309668:0:5812:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1790895297.309689:0:5812:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790895297.309709:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 0000000074f05b6d/0x7911a98710cf8464 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.309728:0:5812:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 0000000074f05b6d/0x7911a98710cf8464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790895297.309777:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790895297.309780:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790895297.309781:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895297.309782:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790895297.309784:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895297.309785:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895297.309786:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790895297.309788:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790895297.309789:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790895297.309790:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790895297.309792:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895297.309793:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790895297.309796:0:5812:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1790895297.309798:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790895297.309800:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790895297.309801:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895297.309802:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790895297.309803:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895297.309804:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895297.309805:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790895297.309806:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790895297.309807:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790895297.309807:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790895297.309808:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895297.309809:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790895297.309827:0:5812:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1790895297.309838:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc0485a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758792448:0@lo:253: 00000100:00100000:1.0:1790895297.309914:0:5812:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895297.309939:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a25c51c2 going to sleep for 11 seconds 00000100:00100000:1.0:1790895297.309957:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792448 00000100:00100000:1.0:1790895297.309961:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792448 00000100:00100000:1.0:1790895297.309985:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790895297.310000:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000f9688a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:5812:x1877889758792448:12345-0@lo:253: 20000000:01000000:1.0:1790895297.310034:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1790895297.310048:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790895297.352278:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790895297.352301:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1790895297.352418:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790895297.352424:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790895297.352445:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.352464:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8448 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.352472:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.352532:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8448 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.352549:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8448 expref: 12 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895297.352562:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000f16d400 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1877889758792576:0@lo:104: 00000100:00100000:0.0:1790895297.352630:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895297.352738:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set 0000000012b40db4 going to sleep for 11 seconds 00000100:00100000:1.0:1790895297.352899:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792576 00000100:00100000:1.0:1790895297.352916:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792576 00000100:00100000:1.0:1790895297.352969:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895297.352978:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c0da669f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+3:5847:x1877889758792576:12345-0@lo:104: 00010000:00010000:1.0:1790895297.352992:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.353044:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790895297.353050:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c0da669f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+3:5847:x1877889758792576:12345-0@lo:104: Request processed in 73us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895297.353057:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1790895297.353201:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895297.353207:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.353214:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000856e2f62 already unused, calling callback (000000005075ebdf) 10000000:00010000:0.0:1790895297.353217:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.353224:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895297.353230:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895297.353235:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790895297.353270:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.353277:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790895297.353305:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.353320:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 00000000856e2f62/0x7911a98710cf8448 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf844f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895297.353338:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895297.353340:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895297.353342:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895297.353439:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895297.353451:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000eefb6aec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758792704:0@lo:103: 00000100:00100000:0.0:1790895297.353485:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895297.354134:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792704 00000100:00100000:3.0:1790895297.354143:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792704 00010000:00010000:3.0:1790895297.354167:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8448 expref: 13 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895297.354192:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790895297.354198:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d488d8cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+13:3308:x1877889758792704:12345-0@lo:103: 00010000:00010000:3.0:1790895297.354211:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895297.354215:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8448 expref: 13 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354224:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8448 expref: 13 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354240:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354248:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790895297.354263:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001839900s 00010000:00010000:3.0:1790895297.354275:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354281:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354286:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354292:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354296:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000032e5030c already unused, calling callback (00000000ab926ebc) 00010000:00010000:3.0:1790895297.354299:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354306:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354313:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895297.354322:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895297.354358:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d488d8cf pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+13:3308:x1877889758792704:12345-0@lo:103: Request processed in 160us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895297.354365:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1790895297.354601:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000173077e5/0x7911a98710cf844f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8448 expref: 12 pid: 5826 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895297.354614:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000f16d400 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1877889758792576:0@lo:104: 00010000:00010000:1.0:1790895297.354632:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.354640:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.354644:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895297.354649:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032e5030c/0x7911a98710cf8480 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895297.355040:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000eefb6aec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758792704:0@lo:103: 00000100:00100000:0.0:1790895297.364228:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000f9688a3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:5812:x1877889758792448:12345-0@lo:253: Request processed in 54222us (54306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895297.364244:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790895297.364326:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc0485a2 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:5812:1877889758792448:0@lo:253: 10000000:01000000:1.0:1790895297.364341:0:5812:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1790895297.364345:0:5812:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790895297.364346:0:5812:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790895297.364348:0:5812:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895297.364349:0:5812:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790895297.364350:0:5812:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895297.364352:0:5812:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895297.364353:0:5812:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790895297.364355:0:5812:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790895297.364356:0:5812:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1790895297.364357:0:5812:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1790895297.364359:0:5812:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895297.364360:0:5812:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790895297.364375:0:5812:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790895297.381941:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895297.382356:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790895297.382564:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895297.382718:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790895297.382957:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895297.383156:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1790895297.391687:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1790895297.391976:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1790895297.392202:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1790895297.392377:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1790895297.395320:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895297.397885:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1790895297.456436:0:5812:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1790895297.497343:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1790895297.499885:0:5866:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1790895297.509475:0:5865:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1790895297.509485:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790895297.515268:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1790895297.519619:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1790895297.520799:0:5812:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790895297.520817:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790895297.521109:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895297.522115:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790895297.522632:0:5812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790895297.522663:0:5812:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790895297.522940:0:5812:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790895297.523132:0:5812:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1790895297.534397:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1790895297.534558:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1790895297.534709:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1790895297.534937:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1790895297.535144:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1790895297.535321:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1790895297.535457:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1790895297.535616:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1790895297.535758:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1790895297.535971:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1790895297.536114:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1790895297.536261:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1790895297.536400:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1790895297.536567:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1790895297.536705:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1790895297.543529:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1790895297.544214:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1790895297.546085:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1790895297.546285:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1790895297.548885:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1790895297.549088:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1790895297.549266:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1790895297.552274:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1790895297.552941:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1790895297.553096:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1790895297.553253:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1790895297.553540:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1790895297.553711:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1790895297.553851:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1790895297.554062:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1790895297.554206:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1790895297.554378:0:5812:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1790895297.559134:0:5812:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1790895297.577487:0:5866:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1790895297.648570:0:5812:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1790895297.648609:0:5812:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9a0b41787988 00100000:10000000:2.0:1790895297.648617:0:5812:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1790895297.650154:0:5812:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790895297.650510:0:5812:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790895297.650536:0:5812:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1790895297.650569:0:5812:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1790895297.654090:0:5866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1790895297.654167:0:5866:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1790895297.654172:0:5866:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1790895298.264067:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895299.293180:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895300.316827:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895301.338385:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895302.360074:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790895302.624134:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790895302.624149:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1790895302.624152:0:38:0:(import.c:65:import_set_state_nolock()) 000000009a739956 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895302.624172:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000009a739956 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895302.624195:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000dddbc91e x1877889758792960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790895302.624204:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790895302.624229:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000dddbc91e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758792960:0@lo:38: 00000100:00100000:2.0:1790895302.624314:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895302.624403:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792960 00000100:00100000:1.0:1790895302.624412:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792960 00000100:00100000:1.0:1790895302.624451:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895302.624457:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007c53eb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1877889758792960:12345-0@lo:38: 00010000:00080000:1.0:1790895302.624482:0:5833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:1.0:1790895302.624515:0:5833:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7911a98710cf8487 00000004:00100000:1.0:1790895302.624578:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790895302.624692:0:5833:0:(import.c:65:import_set_state_nolock()) 000000006f02d217 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895302.624767:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007c53eb92 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877889758792960:12345-0@lo:38: Request processed in 309us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895302.624774:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790895302.624831:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000dddbc91e x1877889758792960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790895312 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790895302.624847:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790895302.624854:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1790895302.624888:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1790895302.624891:0:3307:0:(import.c:65:import_set_state_nolock()) 000000009a739956 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1790895302.624896:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000dddbc91e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758792960:0@lo:38: 00000100:00100000:3.0:1790895302.625103:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758792832:0@lo:400: 00000100:00100000:3.0:1790895302.625138:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895302.626174:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758792832 00000100:00100000:1.0:1790895302.626185:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758792832 00000100:00100000:1.0:1790895302.626379:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790895302.626387:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000344e7954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+11:3311:x1877889758792832:12345-0@lo:400: 00000100:00100000:1.0:1790895302.626449:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000344e7954 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+11:3311:x1877889758792832:12345-0@lo:400: Request processed in 64us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895302.626455:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790895302.626664:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000653f1260 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758792832:0@lo:400: 00000001:02000400:0.0:1790895303.009476:0:6108:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1790895303.386642:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895304.409848:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790895304.665989:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790895304.665996:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf303072000 from 3 10000000:01000000:1.0:1790895304.666002:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790895304.666047:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 0000000081d82b00/0x7911a98710cf848e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895304.666059:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 0000000081d82b00/0x7911a98710cf848e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895304.666069:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 0000000081d82b00/0x7911a98710cf848e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895304.666103:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc0485a2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793088:0@lo:101: 00000100:00100000:1.0:1790895304.666168:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895304.666213:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa65413f going to sleep for 11 seconds 00000100:00100000:0.0:1790895304.666304:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793088 00000100:00100000:0.0:1790895304.666312:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793088 00000100:00100000:0.0:1790895304.666397:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790895304.666406:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000e2460993 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:5828:x1877889758793088:12345-0@lo:101: 00010000:00010000:0.0:1790895304.666420:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895304.666433:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ad58b757/0x7911a98710cf8495 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf848e expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895304.666454:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad58b757/0x7911a98710cf8495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf848e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895304.666464:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ad58b757/0x7911a98710cf8495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf848e expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895304.666472:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ad58b757, rc 0) 00000100:00100000:0.0:1790895304.666509:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000e2460993 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758793088:12345-0@lo:101: Request processed in 105us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895304.666515:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790895304.681248:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc0485a2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793088:0@lo:101: 00010000:00010000:1.0:1790895304.681278:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 0000000081d82b00/0x7911a98710cf848e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895304.681290:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 0000000081d82b00/0x7911a98710cf848e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895304.681360:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc0485a2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793216:0@lo:256: 00000100:00100000:1.0:1790895304.681425:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895304.681474:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000aa65413f going to sleep for 11 seconds 00000100:00100000:1.0:1790895304.681495:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793216 00000100:00100000:1.0:1790895304.681502:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793216 00000100:00100000:1.0:1790895304.681542:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790895304.681549:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000cdfb2a04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758793216:12345-0@lo:256: 20000000:01000000:1.0:1790895304.681570:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790895304.681584:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790895304.681587:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1790895304.681665:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000cdfb2a04 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758793216:12345-0@lo:256: Request processed in 117us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895304.681673:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1790895304.681708:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc0485a2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793216:0@lo:256: 10000000:01000000:1.0:1790895304.681763:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790895304.681770:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: 0000000081d82b00/0x7911a98710cf848e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895304.681921:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: 0000000081d82b00/0x7911a98710cf848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895305.432313:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895306.457982:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895307.481436:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895307.743637:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007b5d5469 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758793344:0@lo:400: 00000100:00100000:0.0:1790895307.743721:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895307.743802:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000432afcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758793472:0@lo:400: 00000100:00100000:0.0:1790895307.743924:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895307.744012:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793344 00000100:00100000:0.0:1790895307.744020:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793344 00000100:00100000:0.0:1790895307.744076:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790895307.744086:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000010685524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:3311:x1877889758793344:12345-0@lo:400: 00000100:00100000:0.0:1790895307.744161:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000010685524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:3311:x1877889758793344:12345-0@lo:400: Request processed in 76us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895307.744169:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790895307.744227:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007b5d5469 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758793344:0@lo:400: 00000100:00100000:2.0:1790895307.745573:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793472 00000100:00100000:2.0:1790895307.745585:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793472 00000100:00100000:2.0:1790895307.745630:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895307.745638:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000eefb6aec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758793472:12345-0@lo:400: 00000100:00100000:2.0:1790895307.745716:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000eefb6aec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758793472:12345-0@lo:400: Request processed in 79us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895307.745723:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790895307.745883:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000432afcf x1877889758793472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895307.745897:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000432afcf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758793472:0@lo:400: 00010000:00010000:2.0:1790895308.504178:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1790895309.256267:0:6311:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffe0124c50 20000000:00000080:3.0:1790895309.256288:0:6311:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf305877c00 uarg=0000000000000000 20000000:01000000:3.0:1790895309.256321:0:6311:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1790895309.256328:0:6311:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1790895309.256334:0:6311:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1790895309.256627:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1790895309.256639:0:6311:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1790895309.267367:0:6311:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790895309.268162:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1790895309.268340:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1790895309.268448:0:6311:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1790895309.268466:0:6311:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1790895309.268482:0:6311:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895309.268503:0:6311:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8456 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895309.268510:0:6311:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895309.268548:0:6311:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8456 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895309.268562:0:6311:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8456 expref: 11 pid: 5825 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895309.268575:0:6311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091470de8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1877889758793600:0@lo:104: 00000100:00100000:0.0:1790895309.268788:0:6311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895309.269177:0:6311:0:(client.c:2716:ptlrpc_set_wait()) set 000000009236f428 going to sleep for 11 seconds 00000100:00100000:1.0:1790895309.269446:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793600 00000100:00100000:1.0:1790895309.269455:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793600 00000100:00100000:1.0:1790895309.269545:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895309.269554:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000aae8d50e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+3:6311:x1877889758793600:12345-0@lo:104: 00010000:00010000:1.0:1790895309.269569:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895309.269657:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790895309.269663:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000aae8d50e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+3:6311:x1877889758793600:12345-0@lo:104: Request processed in 111us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895309.269669:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790895309.269979:0:6311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091470de8 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6311:1877889758793600:0@lo:104: 00010000:00010000:0.0:1790895309.269999:0:6311:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270139:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895309.270151:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270159:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001927d581 already unused, calling callback (000000005075ebdf) 10000000:00010000:2.0:1790895309.270162:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270170:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895309.270176:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895309.270182:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790895309.270239:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270246:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895309.270267:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270274:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: 000000001927d581/0x7911a98710cf8456 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf845d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270292:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895309.270294:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895309.270296:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895309.270308:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000015d10ea5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758793728:0@lo:103: 00000100:00100000:2.0:1790895309.270346:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895309.270410:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793728 00000100:00100000:2.0:1790895309.270415:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793728 00010000:00010000:2.0:1790895309.270442:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8456 expref: 12 pid: 5825 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895309.270464:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895309.270470:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ede0278d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+12:3309:x1877889758793728:12345-0@lo:103: 00010000:00010000:2.0:1790895309.270481:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895309.270484:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8456 expref: 12 pid: 5825 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270494:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8456 expref: 12 pid: 5825 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270506:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bdef898d/0x7911a98710cf845d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8456 expref: 12 pid: 5825 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270519:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270526:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270540:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270547:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270552:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270558:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270573:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000032e5030c already unused, calling callback (00000000ab926ebc) 00010000:00010000:2.0:1790895309.270576:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270583:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270603:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.270613:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895309.270642:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ede0278d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+11:3309:x1877889758793728:12345-0@lo:103: Request processed in 173us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895309.270649:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895309.270676:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000015d10ea5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758793728:0@lo:103: 00010000:00010000:0.0:1790895309.271141:0:6311:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895309.271150:0:6311:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895309.271155:0:6311:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000032e5030c/0x7911a98710cf849c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6311 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895309.528089:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895310.556059:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790895311.127956:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790895311.127964:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf303072000 from 1 10000000:01000000:0.0:1790895311.127969:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790895311.128121:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: 000000008b32d357/0x7911a98710cf84a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895311.128134:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: 000000008b32d357/0x7911a98710cf84a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895311.128144:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: 000000008b32d357/0x7911a98710cf84a3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895311.128384:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091470de8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793856:0@lo:101: 00000100:00100000:0.0:1790895311.128454:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895311.128504:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000001de10955 going to sleep for 11 seconds 00000100:00100000:1.0:1790895311.131003:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793856 00000100:00100000:1.0:1790895311.131021:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793856 00000100:00100000:1.0:1790895311.131092:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790895311.131102:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f7f01783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:5828:x1877889758793856:12345-0@lo:101: 00010000:00010000:1.0:1790895311.131120:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895311.131139:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082b9e33d/0x7911a98710cf84aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf84a3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895311.131171:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082b9e33d/0x7911a98710cf84aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895311.131183:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082b9e33d/0x7911a98710cf84aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895311.131210:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082b9e33d, rc 0) 00000100:00100000:1.0:1790895311.131288:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f7f01783 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758793856:12345-0@lo:101: Request processed in 188us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895311.131294:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790895311.131408:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091470de8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793856:0@lo:101: 00010000:00010000:0.0:1790895311.131436:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: 000000008b32d357/0x7911a98710cf84a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895311.131455:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: 000000008b32d357/0x7911a98710cf84a3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895311.131526:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000091470de8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793984:0@lo:501: 00000100:00100000:0.0:1790895311.131557:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895311.131802:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 000000001de10955 going to sleep for 11 seconds 00000100:00100000:1.0:1790895311.131890:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758793984 00000100:00100000:1.0:1790895311.131895:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758793984 00000100:00100000:1.0:1790895311.131929:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790895311.131936:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000365aa5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758793984:12345-0@lo:501: 00000100:00100000:1.0:1790895311.132188:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000365aa5e2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758793984:12345-0@lo:501: Request processed in 253us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895311.132196:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1790895311.132354:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000091470de8 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758793984:0@lo:501: 00000100:00100000:3.0:1790895311.132393:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aac83a52 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758794112:0@lo:503: 00000100:00100000:3.0:1790895311.132432:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895311.132461:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b5a015d6 going to sleep for 11 seconds 00000100:00100000:1.0:1790895311.132502:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758794112 00000100:00100000:1.0:1790895311.132507:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758794112 00000100:00100000:1.0:1790895311.132535:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790895311.132540:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a82e4386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758794112:12345-0@lo:503: 00000100:00100000:1.0:1790895311.132680:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a82e4386 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758794112:12345-0@lo:503: Request processed in 139us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895311.132687:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790895311.132896:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aac83a52 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758794112:0@lo:503: 00000100:00100000:0.0:1790895311.134981:0:6378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ca67ec5f pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6378:1877889758794240:0@lo:502: 00000100:00100000:0.0:1790895311.135381:0:6378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895311.135433:0:6378:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f3ce1d95 going to sleep for 11 seconds 00000100:00100000:1.0:1790895311.135752:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758794240 00000100:00100000:1.0:1790895311.135760:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758794240 00000100:00100000:1.0:1790895311.135813:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790895311.135821:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000004b8e0638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:6378:x1877889758794240:12345-0@lo:502: 00000100:00100000:1.0:1790895311.136038:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000004b8e0638 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:6378:x1877889758794240:12345-0@lo:502: Request processed in 218us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895311.136045:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790895311.136093:0:6378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ca67ec5f pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6378:1877889758794240:0@lo:502: 00000020:01000000:0.0:1790895311.136126:0:6378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790895311.136135:0:6378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895311.136138:0:6378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790895311.136144:0:6378:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf303072000 00000020:00000080:0.0:1790895311.136147:0:6378:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1790895311.136542:0:6378:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6378:1877889758794368:0@lo:502: 00000100:00100000:0.0:1790895311.137122:0:6378:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895311.137154:0:6378:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3030f8000 going to sleep for 11 seconds 00000100:00100000:1.0:1790895311.137941:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758794368 00000100:00100000:1.0:1790895311.137961:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758794368 00000100:00100000:1.0:1790895311.138008:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1790895311.138018:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:6378:x1877889758794368:12345-0@lo:502: 00000100:00100000:1.0:1790895311.138190:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:6378:x1877889758794368:12345-0@lo:502: Request processed in 174us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895311.138197:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790895311.138600:0:6378:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6378:1877889758794368:0@lo:502: 00000020:01000000:0.0:1790895311.138647:0:6378:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790895311.138655:0:6378:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895311.138657:0:6378:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790895311.138662:0:6378:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1790895311.140012:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1790895311.140039:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790895311.140051:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895311.140065:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895311.576263:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895312.600253:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895312.857921:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758794624:0@lo:400: 00000100:00100000:3.0:1790895312.858007:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895312.858115:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758794496:0@lo:400: 00000100:00100000:1.0:1790895312.858152:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895312.858222:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758794496 00000100:00100000:1.0:1790895312.858230:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758794496 00000100:00100000:1.0:1790895312.858274:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790895312.858283:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:3310:x1877889758794496:12345-0@lo:400: 00000100:00100000:1.0:1790895312.858334:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:3310:x1877889758794496:12345-0@lo:400: Request processed in 51us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895312.858341:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1790895312.858392:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758794496:0@lo:400: 00000100:00100000:1.0:1790895312.860325:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758794624 00000100:00100000:1.0:1790895312.860340:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758794624 00000100:00100000:1.0:1790895312.860399:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895312.860417:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758794624:12345-0@lo:400: 00000100:00100000:1.0:1790895312.860494:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758794624:12345-0@lo:400: Request processed in 79us (2487us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895312.860501:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790895312.860545:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf3031f7480 x1877889758794624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895328 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895312.860560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758794624:0@lo:400: 00010000:00010000:1.0:1790895313.624068:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895314.654026:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895315.674385:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790895316.015962:0:6686:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790895316.015967:0:6686:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1790895316.016312:0:6686:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cf310bbd000 00000020:01000004:1.0:1790895316.016330:0:6686:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1790895316.016352:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790895316.016368:0:6686:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cf3077c0000) 00000020:00000080:1.0:1790895316.016385:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790895316.036033:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790895316.036434:0:6686:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1790895316.122579:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790895316.128348:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790895316.128383:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790895316.128440:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790895316.128470:0:6686:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1790895316.130489:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1790895316.130505:0:6686:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790895316.130518:0:6686:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7911a98710cf84b8 00000020:01000004:0.0:1790895316.130527:0:6686:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1790895316.130564:0:6686:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.154@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1790895316.130569:0:6686:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1790895316.130577:0:6686:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1790895316.130594:0:6686:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1790895316.130609:0:6686:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cf340fb3380) 00000020:00000080:0.0:1790895316.130627:0:6686:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1790895316.134449:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790895316.134658:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1790895316.134665:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1790895316.142226:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1790895316.142243:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790895316.142775:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790895316.142783:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1790895316.152687:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895316.153372:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1790895316.153380:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1790895316.159490:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1790895316.159506:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1790895316.187830:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895316.188222:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1790895316.188230:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1790895316.191659:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1790895316.191675:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790895316.192837:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790895316.192847:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790895316.194831:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895316.195111:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790895316.195118:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1790895316.196786:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1790895316.196804:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1790895316.261539:0:6686:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895316.262081:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1790895316.262089:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1790895316.264160:0:6686:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1790895316.264176:0:6686:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790895316.264730:0:6686:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790895316.264759:0:6686:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790895316.264769:0:6686:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1790895316.295489:0:6686:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790895316.295533:0:6686:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.154@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1790895316.295537:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790895316.295539:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790895316.295540:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790895316.295542:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790895316.295543:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790895316.295544:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790895316.295545:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790895316.295547:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790895316.295548:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790895316.295554:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790895316.295555:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790895316.295559:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1790895316.295562:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790895316.295563:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1790895316.295564:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790895316.295565:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790895316.295566:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790895316.295567:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790895316.295568:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790895316.295569:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790895316.295570:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790895316.295570:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790895316.295571:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790895316.295611:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1790895316.295632:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758794752:0@lo:253: 00000100:00100000:2.0:1790895316.295707:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.295839:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3058033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895316.298280:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758794752 00000100:00100000:1.0:1790895316.298546:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758794752 00000100:00100000:1.0:1790895316.298640:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790895316.298651:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758794752:12345-0@lo:253: 20000000:01000000:1.0:1790895316.298715:0:5824:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1790895316.298719:0:5824:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1790895316.298724:0:5824:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1790895316.298728:0:5824:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1790895316.302223:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790895316.306720:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1790895316.306755:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1790895316.306841:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1790895316.306852:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1790895316.306920:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1790895316.307010:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1790895316.307563:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1790895316.307596:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:0.0:1790895316.307598:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:0.0:1790895316.307636:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1790895316.307644:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1790895316.307691:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1790895316.307700:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:0.0:1790895316.307733:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1790895316.307745:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790895316.307775:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1790895316.307827:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1790895316.309660:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1790895316.309698:0:5824:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:0.0:1790895316.309701:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:0.0:1790895316.309739:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1790895316.309747:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1790895316.309778:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1790895316.309786:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:0.0:1790895316.309832:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1790895316.309842:0:5824:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1790895316.309946:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1790895316.309984:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1790895316.310002:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1790895316.310005:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1790895316.310010:0:5824:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1790895316.310026:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790895316.310029:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790895316.310133:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790895316.310137:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790895316.311012:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1790895316.311178:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1790895316.311235:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1790895316.311640:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1790895316.311676:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1790895316.311734:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1790895316.312137:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1790895316.312141:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790895316.312761:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:2.0:1790895316.312823:0:6702:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:2.0:1790895316.312897:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1790895316.313246:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1790895316.313287:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1790895316.313323:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1790895316.313335:0:5824:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790895316.313337:0:5824:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1790895316.313855:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1790895316.314700:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1790895316.314744:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1790895316.314826:0:5824:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1790895316.314844:0:5824:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790895316.314847:0:5824:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790895316.315016:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790895316.315042:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315059:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf83df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315125:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf83fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315135:0:5824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf846b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8464 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315142:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315180:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8464 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315210:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf846b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8464 expref: 12 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895316.315225:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1877889758794880:0@lo:104: 00000100:00100000:0.0:1790895316.315289:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895316.315401:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf83fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315410:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf83fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 12 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895316.315419:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1877889758795008:0@lo:104: 00000100:00100000:0.0:1790895316.315454:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895316.315624:0:5824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167de00/0x7911a98710cf83df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.315634:0:5824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf83df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 12 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895316.315642:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1877889758795136:0@lo:104: 00000100:00100000:0.0:1790895316.315666:0:5824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895316.315727:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758794880 00000100:00100000:1.0:1790895316.315736:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758794880 00000100:00100000:1.0:1790895316.315776:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795008 00000100:00100000:1.0:1790895316.315779:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795008 00000100:00100000:1.0:1790895316.315792:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790895316.315800:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:5824:x1877889758794880:12345-0@lo:104: 00010000:00010000:1.0:1790895316.315814:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895316.315968:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895316.315990:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1877889758794880:0@lo:104: 00010000:00010000:1.0:1790895316.316176:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790895316.316184:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:5824:x1877889758794880:12345-0@lo:104: Request processed in 384us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.316190:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790895316.316217:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795136 00000100:00100000:1.0:1790895316.316222:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795136 00000100:00100000:1.0:1790895316.316236:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790895316.316241:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:5824:x1877889758795008:12345-0@lo:104: 00010000:00010000:1.0:1790895316.316250:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895316.316331:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1877889758795008:0@lo:104: 00010000:00010000:2.0:1790895316.316548:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790895316.316557:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.316566:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cae00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895316.316570:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.316589:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895316.316608:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895316.316614:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895316.316694:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.316701:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895316.316733:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.316741:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8464 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf846b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.316756:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895316.316759:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.316765:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cba00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895316.316768:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.316774:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895316.316780:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895316.316786:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1790895316.316818:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1790895316.316826:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:5824:x1877889758795008:12345-0@lo:104: Request processed in 583us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.316832:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790895316.316851:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790895316.316888:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+3:5824:x1877889758795136:12345-0@lo:104: 00010000:00010000:1.0:1790895316.316898:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.316946:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790895316.316951:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+3:5824:x1877889758795136:12345-0@lo:104: Request processed in 94us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.316956:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1790895316.316972:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1790895316.317233:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5824:1877889758795136:0@lo:104: 00010000:00010000:1.0:1790895316.317264:0:5824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.317344:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895316.317350:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.317368:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7dc00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:1.0:1790895316.317372:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.317378:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790895316.317385:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895316.317390:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1790895316.317458:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758795264:0@lo:103: 00000100:00100000:0.0:1790895316.317492:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895316.317542:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795264 00000100:00100000:0.0:1790895316.317547:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795264 00010000:00010000:0.0:1790895316.317568:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf846b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8464 expref: 13 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895316.317602:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895316.317609:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+13:3308:x1877889758795264:12345-0@lo:103: 00010000:00010000:0.0:1790895316.317621:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895316.317627:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf846b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8464 expref: 13 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.317650:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf846b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8464 expref: 13 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.317667:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf846b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8464 expref: 13 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.317690:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895316.317717:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+12:3308:x1877889758795264:12345-0@lo:103: Request processed in 109us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.317723:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895316.317751:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758795264:0@lo:103: 00010000:00010000:0.0:1790895316.317962:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895316.317965:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895316.318294:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.318302:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1790895316.318507:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1790895316.318527:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.318535:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf83f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf83fb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.318546:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895316.318548:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895316.318549:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895316.318651:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.318658:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790895316.318672:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.318679:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7dc00/0x7911a98710cf83d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf83df expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.318692:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895316.318693:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895316.318695:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895316.318706:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758795520:0@lo:103: 00000100:00100000:1.0:1790895316.318744:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895316.318789:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795520 00000100:00100000:1.0:1790895316.318795:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795520 00010000:00010000:1.0:1790895316.318816:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167de00/0x7911a98710cf83df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 12 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895316.318849:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790895316.318877:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+12:3310:x1877889758795520:12345-0@lo:103: 00010000:00010000:1.0:1790895316.318887:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895316.318892:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167de00/0x7911a98710cf83df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 12 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.318901:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167de00/0x7911a98710cf83df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 12 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.318912:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf83df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf83d8 expref: 12 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.318924:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895316.318956:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+11:3310:x1877889758795520:12345-0@lo:103: Request processed in 101us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.318963:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790895316.318991:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758795520:0@lo:103: 00000100:00100000:0.0:1790895316.319162:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758795392:0@lo:103: 00000100:00100000:0.0:1790895316.319189:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895316.319394:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795392 00000100:00100000:1.0:1790895316.319399:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795392 00010000:00010000:1.0:1790895316.319417:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf83fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 11 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895316.319538:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790895316.319546:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+11:3308:x1877889758795392:12345-0@lo:103: 00010000:00010000:1.0:1790895316.319554:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895316.319558:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf83fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 11 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319603:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf83fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 11 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319614:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf83fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf83f4 expref: 11 pid: 5824 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319626:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319634:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319649:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319657:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319665:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319672:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319677:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895316.319682:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319692:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319723:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.319734:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895316.319776:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c22300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+10:3308:x1877889758795392:12345-0@lo:103: Request processed in 232us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.319782:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790895316.319834:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758795392:0@lo:103: 00010000:00010000:0.0:1790895316.320318:0:5824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.320327:0:5824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.320334:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790895316.320347:0:5824:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790895316.381624:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+9:6686:x1877889758794752:12345-0@lo:253: Request processed in 82966us (85907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895316.381642:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790895316.381773:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758794752:0@lo:253: 10000000:01000000:1.0:1790895316.381791:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1790895316.381795:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790895316.381797:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1790895316.381798:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895316.381799:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1790895316.381800:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895316.381801:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895316.381803:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790895316.381804:0:6686:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790895316.381806:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895316.381807:0:6686:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790895316.381828:0:6686:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf310bbd000 from lustre-OST0000 10000000:01000000:1.0:1790895316.381854:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1790895316.381892:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1790895316.381899:0:6686:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf3031ab380 local copy 10000000:01000000:1.0:1790895316.381903:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790895316.382048:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.382162:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.382175:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895316.382210:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758795648:0@lo:101: 00000100:00100000:1.0:1790895316.382252:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895316.382359:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306098600 going to sleep for 11 seconds 00000100:00100000:0.0:1790895316.382570:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795648 00000100:00100000:0.0:1790895316.382589:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795648 00000100:00100000:0.0:1790895316.382674:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790895316.382685:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+9:6686:x1877889758795648:12345-0@lo:101: 00010000:00010000:0.0:1790895316.382700:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895316.382714:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf84cd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.382749:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf84cd expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.382759:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf84cd expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.382768:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7de00, rc 0) 00000100:00100000:0.0:1790895316.382813:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+10:6686:x1877889758795648:12345-0@lo:101: Request processed in 131us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.382819:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1790895316.382892:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758795648:0@lo:101: 00010000:00010000:1.0:1790895316.382906:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.382926:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895316.383049:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758795776:0@lo:501: 00000100:00100000:1.0:1790895316.383093:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895316.383427:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306098600 going to sleep for 11 seconds 00000100:00100000:2.0:1790895316.383816:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795776 00000100:00100000:2.0:1790895316.383824:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795776 00000100:00100000:2.0:1790895316.383888:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790895316.383898:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+10:6686:x1877889758795776:12345-0@lo:501: 00000100:00100000:2.0:1790895316.384365:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+10:6686:x1877889758795776:12345-0@lo:501: Request processed in 469us (1271us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790895316.384373:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790895316.384471:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758795776:0@lo:501: 10000000:01000000:1.0:1790895316.384488:0:6686:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790895316.384515:0:6686:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790895316.384521:0:6686:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.384530:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.384538:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.384565:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790895316.384607:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf310bbd000 10000000:01000000:1.0:1790895316.384613:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790895316.384618:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cf3031ab380 10000000:01000000:1.0:1790895316.384620:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1790895316.384623:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cf3031ab380 from 1 10000000:01000000:1.0:1790895316.384626:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1790895316.384652:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.384660:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.384669:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895316.384684:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758795904:0@lo:101: 00000100:00100000:1.0:1790895316.384715:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895316.384740:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306098900 going to sleep for 11 seconds 00010000:00010000:2.0:1790895316.384889:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895316.384896:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.384904:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895316.384908:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.384928:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895316.384946:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895316.384953:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895316.384970:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.384975:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895316.384991:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.384998:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf84cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7911a98710cf84d4 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385015:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895316.385016:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895316.385018:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895316.385026:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895316.385036:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758796032:0@lo:103: 00000100:00100000:2.0:1790895316.385062:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.385210:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796032 00000100:00100000:2.0:1790895316.385216:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796032 00000100:00100000:2.0:1790895316.385247:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895316.385254:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+10:3310:x1877889758796032:12345-0@lo:103: 00010000:00010000:2.0:1790895316.385264:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895316.385276:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf84d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf84cd expref: 10 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385289:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895316.385320:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+9:3310:x1877889758796032:12345-0@lo:103: Request processed in 66us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895316.385326:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895316.385353:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758796032:0@lo:103: 00000100:00100000:2.0:1790895316.385367:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758795904 00000100:00100000:2.0:1790895316.385369:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758795904 00000100:00100000:2.0:1790895316.385382:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790895316.385387:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+9:6686:x1877889758795904:12345-0@lo:101: 00010000:00010000:2.0:1790895316.385397:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895316.385409:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301522e00/0x7911a98710cf84e2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf84db expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385428:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301522e00/0x7911a98710cf84e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf84db expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385498:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301522e00/0x7911a98710cf84e2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf84db expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385506:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301522e00, rc 0) 00000100:00100000:2.0:1790895316.385534:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+10:6686:x1877889758795904:12345-0@lo:101: Request processed in 146us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895316.385539:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790895316.385566:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758795904:0@lo:101: 00010000:00010000:2.0:1790895316.385590:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84e2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385600:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf84e2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895316.385625:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790895316.385636:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84e2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385644:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84e2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895316.385650:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790895316.385654:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790895316.385659:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790895316.385661:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790895316.385674:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385680:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385688:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895316.385699:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796160:0@lo:101: 00000100:00100000:2.0:1790895316.385721:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.385735:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895316.385748:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796160 00000100:00100000:2.0:1790895316.385751:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796160 00000100:00100000:2.0:1790895316.385767:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790895316.385773:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+10:6686:x1877889758796160:12345-0@lo:101: 00010000:00010000:2.0:1790895316.385779:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895316.385794:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf84e9 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385807:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385815:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 11 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.385822:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301522200, rc 0) 00000100:00100000:2.0:1790895316.385850:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796160:12345-0@lo:101: Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895316.385892:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790895316.386058:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796160:0@lo:101: 00010000:00010000:2.0:1790895316.386321:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895316.386330:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895316.386418:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796288:0@lo:501: 00000100:00100000:2.0:1790895316.386566:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.386639:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895316.386702:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796288 00000100:00100000:3.0:1790895316.386708:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796288 00000100:00100000:0.0:1790895316.386809:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1790895316.386819:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796288:12345-0@lo:501: 00000100:00100000:0.0:1790895316.387369:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796288:12345-0@lo:501: Request processed in 551us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.387376:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790895316.387457:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796288:0@lo:501: 00000100:00100000:2.0:1790895316.387488:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796416:0@lo:503: 00000100:00100000:2.0:1790895316.387522:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.387549:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803f00 going to sleep for 11 seconds 00000100:00100000:0.0:1790895316.387656:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796416 00000100:00100000:0.0:1790895316.387661:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796416 00000100:00100000:0.0:1790895316.387691:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1790895316.387697:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796416:12345-0@lo:503: 00000100:00100000:0.0:1790895316.387845:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796416:12345-0@lo:503: Request processed in 148us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.387852:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790895316.388002:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796416:0@lo:503: 00000040:00080000:3.0:1790895316.388247:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790895316.388308:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796544:0@lo:502: 00000100:00100000:3.0:1790895316.388341:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.388368:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e65d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790895316.388515:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796544 00000100:00100000:0.0:1790895316.388519:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796544 00000100:00100000:0.0:1790895316.388535:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1790895316.388540:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796544:12345-0@lo:502: 00000100:00100000:0.0:1790895316.388681:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796544:12345-0@lo:502: Request processed in 140us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.388688:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790895316.388973:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796544:0@lo:502: 00000040:00080000:3.0:1790895316.389258:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1790895316.389299:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1790895316.389324:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1790895316.389360:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1790895316.389388:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1790895316.389412:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1790895316.389433:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796672:0@lo:502: 00000100:00100000:3.0:1790895316.389527:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.389557:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e65d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895316.389655:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796672 00000100:00100000:2.0:1790895316.389666:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796672 00000100:00100000:2.0:1790895316.389690:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790895316.389697:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796672:12345-0@lo:502: 00000100:00100000:2.0:1790895316.389833:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796672:12345-0@lo:502: Request processed in 137us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895316.389839:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1790895316.390056:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796672:0@lo:502: 00000040:00080000:3.0:1790895316.390202:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1790895316.390212:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1790895316.390766:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790895316.390774:0:6706:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790895316.390781:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895316.390783:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790895316.390788:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790895316.390803:0:6706:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cf306508000) 00000020:00000080:3.0:1790895316.390823:0:6706:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790895316.390829:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790895316.391271:0:6706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf310bbd000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790895316.391278:0:6706:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790895316.391293:0:6706:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7911a98710cf84fe 00010000:00010000:2.0:1790895316.396735:0:6706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1790895316.397414:0:6706:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1790895316.400743:0:6706:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1790895316.401326:0:6706:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1790895316.409495:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1790895316.410174:0:6706:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1790895316.412770:0:6706:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1790895316.412784:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895316.412790:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895316.412793:0:6706:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1790895316.412798:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895316.412802:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895316.412803:0:6706:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790895316.412806:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790895316.412808:0:6706:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790895316.414137:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895316.414147:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895316.414149:0:6706:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790895316.414155:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1790895316.425184:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1790895316.425231:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790895316.425248:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.425261:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895316.425291:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf310bbd000 from 1 10000000:01000000:3.0:1790895316.425294:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790895316.425337:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.425345:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.425356:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895316.425382:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796800:0@lo:101: 00000100:00100000:3.0:1790895316.425455:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.425548:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e656c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895316.437492:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796800 00000100:00100000:1.0:1790895316.437510:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796800 00000100:00100000:1.0:1790895316.437615:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790895316.437627:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:6686:x1877889758796800:12345-0@lo:101: 00010000:00010000:1.0:1790895316.437649:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895316.437669:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8505 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.437703:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8505 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.437715:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8505 expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.437733:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c200, rc 0) 00000100:00100000:1.0:1790895316.437811:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758796800:12345-0@lo:101: Request processed in 187us (12355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.437819:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790895316.437931:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796800:0@lo:101: 00010000:00010000:3.0:1790895316.437952:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.437975:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895316.438112:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796928:0@lo:501: 00000100:00100000:3.0:1790895316.438149:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.438506:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e656c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895316.438592:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758796928 00000100:00100000:0.0:1790895316.438598:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758796928 00000100:00100000:0.0:1790895316.438632:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1790895316.438641:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758796928:12345-0@lo:501: 00000100:00100000:0.0:1790895316.440507:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758796928:12345-0@lo:501: Request processed in 1858us (2347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.440519:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790895316.440631:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758796928:0@lo:501: 00000100:00100000:3.0:1790895316.440687:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797056:0@lo:503: 00000100:00100000:3.0:1790895316.440745:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.440791:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e656c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895316.440973:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797056 00000100:00100000:2.0:1790895316.440982:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797056 00000100:00100000:2.0:1790895316.441024:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790895316.441036:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758797056:12345-0@lo:503: 00000100:00100000:2.0:1790895316.441295:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758797056:12345-0@lo:503: Request processed in 262us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895316.441311:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790895316.441332:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797056:0@lo:503: 00000040:00080000:3.0:1790895316.441623:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790895316.441686:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797184:0@lo:502: 00000100:00100000:3.0:1790895316.441722:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.441758:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e656c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895316.441820:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797184 00000100:00100000:1.0:1790895316.441826:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797184 00000100:00100000:1.0:1790895316.441850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1790895316.441880:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758797184:12345-0@lo:502: 00000100:00100000:1.0:1790895316.442798:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758797184:12345-0@lo:502: Request processed in 937us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.442808:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790895316.443594:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797184:0@lo:502: 00000040:00080000:3.0:1790895316.446411:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1790895316.446521:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1790895316.446572:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797312:0@lo:502: 00000100:00100000:3.0:1790895316.446669:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.446723:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e656c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895316.448231:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797312 00000100:00100000:0.0:1790895316.448247:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797312 00000100:00100000:0.0:1790895316.448313:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1790895316.448325:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758797312:12345-0@lo:502: 00000100:00100000:0.0:1790895316.448637:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758797312:12345-0@lo:502: Request processed in 315us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.448646:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790895316.448947:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797312:0@lo:502: 00000040:00080000:3.0:1790895316.450412:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1790895316.450435:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1790895316.459290:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790895316.459307:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895316.459310:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1790895316.459318:0:6710:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf310bbd000 00000020:00000080:0.0:1790895316.459321:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1790895316.459342:0:6710:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790895316.459346:0:6710:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895316.459347:0:6710:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1790895316.459350:0:6710:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1790895316.459631:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1790895316.459660:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790895316.459685:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.459699:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895316.459741:0:6686:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790895316.459745:0:6686:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf310bbd000 10000000:01000000:3.0:1790895316.459748:0:6686:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf310bbd000 10000000:01000000:3.0:1790895316.459766:0:6686:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790895316.459772:0:6686:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf310bbd000 from 1 10000000:01000000:3.0:1790895316.459775:0:6686:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895316.459815:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.459825:0:6686:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.459837:0:6686:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895316.459892:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797440:0@lo:101: 00000100:00100000:3.0:1790895316.459971:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.460032:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e65e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895316.460564:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797440 00000100:00100000:1.0:1790895316.460574:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797440 00000100:00100000:1.0:1790895316.460642:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1790895316.460651:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:6686:x1877889758797440:12345-0@lo:101: 00010000:00010000:1.0:1790895316.460666:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895316.460682:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8513 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.460709:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8513 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.460719:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8513 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.460728:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167de00, rc 0) 00000100:00100000:1.0:1790895316.460786:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797440:12345-0@lo:101: Request processed in 136us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.460801:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1790895316.460926:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797440:0@lo:101: 00010000:00010000:0.0:1790895316.460942:0:6686:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.460956:0:6686:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895316.461081:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797568:0@lo:501: 00000100:00100000:0.0:1790895316.461119:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895316.461144:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9600 going to sleep for 11 seconds 00000100:00100000:3.0:1790895316.461362:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797568 00000100:00100000:3.0:1790895316.461368:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797568 00000100:00100000:3.0:1790895316.461413:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790895316.461420:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797568:12345-0@lo:501: 00000100:00100000:3.0:1790895316.461702:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797568:12345-0@lo:501: Request processed in 281us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895316.461710:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790895316.461788:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797568:0@lo:501: 00000100:00100000:2.0:1790895316.461826:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797696:0@lo:503: 00000100:00100000:2.0:1790895316.461895:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.461915:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3058033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895316.461978:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797696 00000100:00100000:1.0:1790895316.461983:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797696 00000100:00100000:1.0:1790895316.462002:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1790895316.462009:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797696:12345-0@lo:503: 00000100:00100000:1.0:1790895316.462369:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797696:12345-0@lo:503: Request processed in 360us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.462377:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1790895316.462515:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797696:0@lo:503: 00000040:00080000:2.0:1790895316.462836:0:6686:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790895316.462939:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797824:0@lo:502: 00000100:00100000:2.0:1790895316.462982:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.463010:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3058033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895316.463210:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797824 00000100:00100000:3.0:1790895316.463216:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797824 00000100:00100000:3.0:1790895316.463252:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790895316.463260:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797824:12345-0@lo:502: 00000100:00100000:3.0:1790895316.463511:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797824:12345-0@lo:502: Request processed in 251us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895316.463519:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1790895316.463710:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797824:0@lo:502: 00000040:00080000:2.0:1790895316.464036:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1790895316.464212:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1790895316.464250:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1790895316.464300:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1790895316.464336:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1790895316.464402:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1790895316.464440:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1790895316.464474:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1790895316.464521:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1790895316.464560:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1790895316.464610:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1790895316.464673:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1790895316.464711:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1790895316.464758:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1790895316.464807:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1790895316.464845:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1790895316.464953:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1790895316.465003:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1790895316.465044:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1790895316.465197:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1790895316.465258:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1790895316.465312:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1790895316.465345:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1790895316.465389:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1790895316.465426:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1790895316.465461:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1790895316.465510:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1790895316.465547:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1790895316.465612:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797952:0@lo:502: 00000100:00100000:2.0:1790895316.465682:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.465820:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758797952 00000100:00100000:3.0:1790895316.465828:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758797952 00000100:00100000:3.0:1790895316.465908:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790895316.465918:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797952:12345-0@lo:502: 00000100:00100000:2.0:1790895316.466063:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3058033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895316.466814:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758797952:12345-0@lo:502: Request processed in 895us (1130us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895316.466824:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1790895316.467258:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758797952:0@lo:502: 00000040:00080000:2.0:1790895316.467378:0:6686:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1790895316.467391:0:6686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1790895316.469458:0:6711:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1790895316.469477:0:6711:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cf3077c19c0) 00000020:00000080:1.0:1790895316.469500:0:6711:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1790895316.469613:0:6711:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf310bbd000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790895316.469617:0:6711:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf310bbd000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1790895316.469620:0:6711:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf310bbd000 3 00010000:00080000:1.0:1790895316.469651:0:6711:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf20114d800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.154@tcp at head 00010000:00010000:2.0:1790895316.473479:0:6711:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1790895316.473716:0:6711:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1790895316.474023:0:6711:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790895316.474036:0:6711:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7911a98710cf8528 00000100:00080000:2.0:1790895316.474048:0:6711:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790895316.474061:0:6711:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cf20114d800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895316.474178:0:6711:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf336be6d80 x1877889758798080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895316.474234:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758798080:0@lo:38: 00000100:00100000:2.0:1790895316.474302:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895316.480401:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798080 00000100:00100000:2.0:1790895316.480435:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798080 00000100:00100000:2.0:1790895316.480487:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790895316.480497:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1877889758798080:12345-0@lo:38: 00010000:00080000:2.0:1790895316.480530:0:5833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 189 last 0 00000020:00000080:2.0:1790895316.480595:0:5833:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7911a98710cf852f 00000004:00100000:2.0:1790895316.480614:0:5833:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790895316.480649:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8cf33b795800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895316.481913:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877889758798080:12345-0@lo:38: Request processed in 1409us (7603us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895316.481927:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1790895316.482020:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf336be6d80 x1877889758798080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790895326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895316.482032:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790895316.482041:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1790895316.482050:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790895316.482054:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790895316.482057:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf20114d800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790895316.482064:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758798080:0@lo:38: 00000100:00080000:2.0:1790895316.482166:0:6711:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1790895316.484476:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758798208:0@lo:400: 00000100:00100000:3.0:1790895316.484560:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1790895316.485273:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1790895316.485347:0:6686:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1790895316.485377:0:6686:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790895316.485537:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.485550:0:6686:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895316.485591:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798208 00000100:00100000:1.0:1790895316.485601:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798208 00000020:01000004:0.0:1790895316.485615:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790895316.485618:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790895316.485620:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895316.485622:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895316.485624:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895316.485625:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895316.485627:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895316.485628:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895316.485630:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895316.485631:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895316.485633:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790895316.485637:0:6686:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1790895316.485640:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790895316.485642:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790895316.485643:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895316.485645:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895316.485646:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895316.485647:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895316.485653:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895316.485654:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895316.485655:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895316.485658:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000100:00100000:1.0:1790895316.485659:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000020:01000004:0.0:1790895316.485660:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000100:00100000:1.0:1790895316.485674:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758798208:12345-0@lo:400: 10000000:01000000:0.0:1790895316.485690:0:6686:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790895316.485706:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758798336:0@lo:253: 00010000:00080000:3.0:1790895316.485824:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf338c21880 x1877889758798208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895316.485838:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758798208:0@lo:400: 00000100:00100000:0.0:1790895316.485952:0:6686:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895316.486071:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1790895316.486173:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798336 00000100:00100000:0.0:1790895316.486178:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798336 00000100:00100000:0.0:1790895316.486210:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790895316.486217:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758798336:12345-0@lo:253: 20000000:01000000:0.0:1790895316.486239:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790895316.486256:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1790895316.486992:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758798208:12345-0@lo:400: Request processed in 1315us (2426us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895316.487003:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:0.0:1790895316.528241:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790895316.528257:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1790895316.528621:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790895316.528627:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790895316.528653:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.528675:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf8495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf848e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.528698:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.529143:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf8495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf848e expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.529172:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf8495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf848e expref: 13 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895316.529187:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1877889758798464:0@lo:104: 00000100:00100000:1.0:1790895316.529254:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895316.529436:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798464 00000100:00100000:0.0:1790895316.529446:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798464 00000100:00100000:0.0:1790895316.529695:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790895316.529703:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+3:5847:x1877889758798464:12345-0@lo:104: 00010000:00010000:0.0:1790895316.529714:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895316.529754:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790895316.529759:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+3:5847:x1877889758798464:12345-0@lo:104: Request processed in 58us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895316.529763:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790895316.529902:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306098000 going to sleep for 11 seconds 00000100:00100000:1.0:1790895316.529927:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1877889758798464:0@lo:104: 00010000:00010000:1.0:1790895316.529946:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.541486:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895316.541506:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.541522:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895316.541527:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.541538:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895316.541547:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895316.541554:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895316.541637:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.541661:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895316.541692:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.541702:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf848e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8495 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.541911:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895316.541915:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895316.541919:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895316.541944:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895316.541968:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758798592:0@lo:103: 00000100:00100000:3.0:1790895316.542043:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895316.542111:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798592 00000100:00100000:3.0:1790895316.542120:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798592 00010000:00010000:3.0:1790895316.542157:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf8495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf848e expref: 14 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895316.542189:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790895316.542198:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306504450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+14:3308:x1877889758798592:12345-0@lo:103: 00010000:00010000:3.0:1790895316.542430:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895316.542437:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf8495 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf848e expref: 14 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542464:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf8495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf848e expref: 14 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542479:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf8495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf848e expref: 14 pid: 5825 timeout: 339 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542506:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542516:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790895316.542532:0:5817:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013905391s 00010000:00010000:3.0:1790895316.542537:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542544:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542550:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542557:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542561:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ca00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895316.542566:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.542574:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.550213:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895316.550239:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.553988:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.554010:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8536 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895316.554052:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895316.555239:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:6686:x1877889758798336:12345-0@lo:253: Request processed in 69014us (69278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895316.555255:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790895316.555365:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:6686:1877889758798336:0@lo:253: 10000000:01000000:0.0:1790895316.555380:0:6686:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790895316.555394:0:6686:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790895316.555395:0:6686:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790895316.555397:0:6686:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895316.555398:0:6686:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895316.555399:0:6686:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895316.555401:0:6686:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895316.555402:0:6686:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895316.555403:0:6686:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895316.555405:0:6686:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895316.555406:0:6686:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895316.555408:0:6686:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790895316.555426:0:6686:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1790895316.560480:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306504450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+12:3308:x1877889758798592:12345-0@lo:103: Request processed in 18273us (18427us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895316.560498:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790895316.560516:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758798592:0@lo:103: 00080000:10000000:2.0:1790895316.563565:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895316.563766:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790895316.564636:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895316.565364:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790895316.565606:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895316.565960:0:6686:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1790895316.567288:0:6686:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1790895316.700559:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1790895316.804664:0:6686:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1790895316.804673:0:6686:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1790895316.804708:0:6686:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790895316.804790:0:6686:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790895316.804803:0:6686:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1790895316.804834:0:6686:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1790895317.722763:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895318.750369:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895319.774441:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790895320.216048:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790895320.216056:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf303072000 from 21 10000000:01000000:3.0:1790895320.216061:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895320.216113:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.216126:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.216139:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895320.216165:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758798720:0@lo:101: 00000100:00100000:3.0:1790895320.216242:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895320.216375:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798720 00000100:00100000:2.0:1790895320.216385:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798720 00000100:00100000:2.0:1790895320.216435:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790895320.216447:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758798720:12345-0@lo:101: 00010000:00010000:2.0:1790895320.216461:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1790895320.216471:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3600 going to sleep for 11 seconds 00010000:00010000:2.0:1790895320.216477:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf853d expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895320.216503:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf853d expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895320.216579:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf853d expref: 13 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895320.216820:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301522a00, rc 0) 00000100:00100000:2.0:1790895320.216996:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758798720:12345-0@lo:101: Request processed in 551us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895320.216998:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758798720:0@lo:101: 00000100:00100000:2.0:1790895320.217011:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:3.0:1790895320.217021:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.217032:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895320.217088:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758798848:0@lo:501: 00000100:00100000:3.0:1790895320.217131:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895320.217228:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798848 00000100:00100000:3.0:1790895320.217232:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3600 going to sleep for 11 seconds 00000100:00100000:0.0:1790895320.217234:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798848 00000100:00100000:0.0:1790895320.217375:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790895320.217385:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758798848:12345-0@lo:501: 00000100:00100000:0.0:1790895320.217896:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758798848:12345-0@lo:501: Request processed in 512us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895320.217904:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790895320.218459:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758798848:0@lo:501: 00000100:00100000:3.0:1790895320.218502:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758798976:0@lo:503: 00000100:00100000:3.0:1790895320.218565:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895320.218793:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758798976 00000100:00100000:1.0:1790895320.218801:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758798976 00000100:00100000:1.0:1790895320.218847:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790895320.218869:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758798976:12345-0@lo:503: 00000100:00100000:1.0:1790895320.219186:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758798976:12345-0@lo:503: Request processed in 332us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895320.219369:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3600 going to sleep for 11 seconds 00000100:00100000:3.0:1790895320.219384:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758798976:0@lo:503: 00000100:00100000:1.0:1790895320.219847:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1790895320.220092:0:6872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6872:1877889758799104:0@lo:502: 00000100:00100000:2.0:1790895320.220143:0:6872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895320.220298:0:6872:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305964c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790895320.220412:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758799104 00000100:00100000:0.0:1790895320.220418:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758799104 00000100:00100000:0.0:1790895320.220495:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790895320.220504:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:6872:x1877889758799104:12345-0@lo:502: 00000100:00100000:0.0:1790895320.220796:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:6872:x1877889758799104:12345-0@lo:502: Request processed in 293us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895320.220803:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790895320.220906:0:6872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6872:1877889758799104:0@lo:502: 00000100:00100000:2.0:1790895320.221469:0:6872:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6872:1877889758799232:0@lo:502: 00000100:00100000:2.0:1790895320.221530:0:6872:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895320.222916:0:6872:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305964c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895320.223115:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758799232 00000100:00100000:3.0:1790895320.223125:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758799232 00000100:00100000:3.0:1790895320.223174:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1790895320.223183:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6872:x1877889758799232:12345-0@lo:502: 00000100:00100000:3.0:1790895320.225457:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:6872:x1877889758799232:12345-0@lo:502: Request processed in 1998us (3652us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895320.225474:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790895320.225745:0:6872:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6872:1877889758799232:0@lo:502: 00000040:00080000:2.0:1790895320.225784:0:6872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1790895320.226038:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1790895320.226055:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790895320.226064:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.226076:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895320.226086:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790895320.226088:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf303072000 from 4 10000000:01000000:3.0:1790895320.226091:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790895320.226124:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.226145:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.226153:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895320.226171:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799360:0@lo:101: 00000100:00100000:3.0:1790895320.226727:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.226816:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1790895320.226902:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758799360 00000100:00100000:1.0:1790895320.226909:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758799360 00000100:00100000:0.0:1790895320.227130:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1790895320.227141:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758799360:12345-0@lo:101: 00010000:00010000:0.0:1790895320.227155:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895320.227169:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf854b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.227310:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf854b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.227326:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf854b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.227335:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7de00, rc 0) 00000100:00100000:0.0:1790895320.227388:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758799360:12345-0@lo:101: Request processed in 250us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895320.227395:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790895320.227470:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799360:0@lo:101: 00010000:00010000:3.0:1790895320.227488:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.227498:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895320.227576:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799488:0@lo:256: 00000100:00100000:3.0:1790895320.227651:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.232889:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1790895320.233151:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758799488 00000100:00100000:1.0:1790895320.233163:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758799488 00000100:00100000:1.0:1790895320.233228:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790895320.233242:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758799488:12345-0@lo:256: 20000000:01000000:1.0:1790895320.233269:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790895320.233304:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790895320.233308:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1790895320.233415:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758799488:12345-0@lo:256: Request processed in 178us (5763us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895320.233422:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790895320.233794:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799488:0@lo:256: 10000000:01000000:3.0:1790895320.233844:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790895320.233854:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.233894:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895320.233914:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790895320.233917:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1790895320.233920:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790895320.234021:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.234029:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.234038:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895320.234055:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799616:0@lo:101: 00000100:00100000:3.0:1790895320.234088:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.234114:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1790895320.234174:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758799616 00000100:00100000:1.0:1790895320.234179:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758799616 00000100:00100000:1.0:1790895320.234216:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790895320.234222:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758799616:12345-0@lo:101: 00010000:00010000:1.0:1790895320.234231:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895320.234243:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8559 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895320.234264:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8559 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895320.234273:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8559 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895320.234281:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ca00, rc 0) 00000100:00100000:1.0:1790895320.234329:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758799616:12345-0@lo:101: Request processed in 107us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895320.234341:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790895320.234758:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799616:0@lo:101: 00010000:00010000:3.0:1790895320.234774:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895320.234784:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895320.234835:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799744:0@lo:501: 00000100:00100000:3.0:1790895320.234898:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.234932:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3840 going to sleep for 11 seconds 00000100:00100000:2.0:1790895320.235068:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758799744 00000100:00100000:2.0:1790895320.235073:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758799744 00000100:00100000:2.0:1790895320.235100:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790895320.235107:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758799744:12345-0@lo:501: 00000100:00100000:2.0:1790895320.235378:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758799744:12345-0@lo:501: Request processed in 271us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895320.235384:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790895320.235558:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799744:0@lo:501: 00000100:00100000:3.0:1790895320.235588:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799872:0@lo:503: 00000100:00100000:3.0:1790895320.235801:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.235825:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3840 going to sleep for 11 seconds 00000100:00100000:1.0:1790895320.235899:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758799872 00000100:00100000:1.0:1790895320.235904:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758799872 00000100:00100000:1.0:1790895320.235993:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790895320.236002:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758799872:12345-0@lo:503: 00000100:00100000:1.0:1790895320.236314:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758799872:12345-0@lo:503: Request processed in 313us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895320.236321:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790895320.236470:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758799872:0@lo:503: 00000100:00100000:3.0:1790895320.238014:0:6873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6873:1877889758800000:0@lo:502: 00000100:00100000:3.0:1790895320.238101:0:6873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.238274:0:6873:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e39c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895320.238357:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800000 00000100:00100000:1.0:1790895320.238365:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800000 00000100:00100000:1.0:1790895320.238442:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790895320.238453:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:6873:x1877889758800000:12345-0@lo:502: 00000100:00100000:1.0:1790895320.238908:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:6873:x1877889758800000:12345-0@lo:502: Request processed in 457us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895320.238916:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790895320.239153:0:6873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6873:1877889758800000:0@lo:502: 00000020:01000000:3.0:1790895320.239186:0:6873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790895320.239205:0:6873:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790895320.239212:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895320.239215:0:6873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790895320.239219:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790895320.239223:0:6873:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.154@tcp to nid 0x20000c0a8c99a (192.168.201.154@tcp) 00000020:01000000:3.0:1790895320.239247:0:6873:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790895320.239250:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790895320.239265:0:6873:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cf3065099c0) 00000020:00000080:3.0:1790895320.239285:0:6873:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1790895320.239304:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790895320.239401:0:6873:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790895320.239406:0:6873:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790895320.239415:0:6873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf856e 00010000:00080000:3.0:1790895320.239445:0:6873:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf332954800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:3.0:1790895320.240302:0:6873:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1790895320.297472:0:6873:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1790895320.297501:0:6873:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790895320.298110:0:6873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895320.298683:0:6873:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895320.298741:0:6873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1790895320.298823:0:6873:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1790895320.299604:0:6874:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790895320.299611:0:6874:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790895320.304345:0:6873:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790895320.304440:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1790895320.304489:0:6873:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1790895320.307902:0:6873:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf8575 00000100:00080000:2.0:1790895320.307934:0:6873:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790895320.307949:0:6873:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf332954800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895320.308097:0:6873:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf336be7b80 x1877889758800128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790895320.308223:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758800128:0@lo:8: 00000100:00100000:1.0:1790895320.308293:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790895320.308371:0:6873:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1790895320.308477:0:6873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895320.308485:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895320.308488:0:6873:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1790895320.308491:0:6873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895320.308495:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895320.308496:0:6873:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790895320.308499:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790895320.308501:0:6873:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1790895320.308539:0:6873:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6873:1877889758800256:0@lo:502: 00000100:00100000:2.0:1790895320.308611:0:6873:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895320.308640:0:6873:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305964000 going to sleep for 11 seconds 00000100:00100000:2.0:1790895320.308705:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758800384:0@lo:400: 00000100:00100000:2.0:1790895320.308732:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895320.308752:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895320.308757:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758800512:0@lo:400: 00000100:00100000:2.0:1790895320.308773:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895320.308810:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800384 00000100:00100000:2.0:1790895320.308818:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800384 00000100:00100000:2.0:1790895320.308854:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800512 00000100:00100000:2.0:1790895320.308878:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800512 00000100:00100000:2.0:1790895320.308903:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790895320.308911:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758800384:12345-0@lo:400: 00000100:00100000:2.0:1790895320.308962:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758800384:12345-0@lo:400: Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895320.308968:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790895320.308984:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790895320.308990:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758800512:12345-0@lo:400: 00000100:00100000:3.0:1790895320.309199:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800128 00000100:00100000:3.0:1790895320.309204:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800128 00000100:00100000:3.0:1790895320.309229:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790895320.309234:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1877889758800128:12345-0@lo:8: 00010000:00080000:3.0:1790895320.309257:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1790895320.309285:0:6688:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf857c 00002000:00100000:3.0:1790895320.309325:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cf332957800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1790895320.309330:0:6688:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1790895320.309334:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1790895320.309464:0:6688:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1790895320.309613:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1790895320.309639:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf332955000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895320.309764:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800256 00000100:00100000:0.0:1790895320.309770:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800256 00000100:00100000:0.0:1790895320.309801:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790895320.309808:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+15:6873:x1877889758800256:12345-0@lo:502: 00000100:00100000:0.0:1790895320.310072:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+15:6873:x1877889758800256:12345-0@lo:502: Request processed in 264us (1459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895320.310080:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1790895320.310122:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895320.310183:0:6873:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:6873:1877889758800256:0@lo:502: 00000020:01000000:0.0:1790895320.310214:0:6873:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790895320.310241:0:6873:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895320.310244:0:6873:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1790895320.310254:0:6873:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1790895320.310376:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1790895320.310394:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1790895320.310406:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.310417:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895320.310427:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1790895320.310429:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf3031ab380 from 1 10000000:01000000:0.0:1790895320.310432:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1790895320.310460:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.310468:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.310477:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895320.310491:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758800640:0@lo:101: 00000100:00100000:0.0:1790895320.310534:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895320.310563:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861b240 going to sleep for 11 seconds 00000100:00100000:0.0:1790895320.310578:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800640 00000100:00100000:0.0:1790895320.310582:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800640 00000100:00100000:0.0:1790895320.310627:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790895320.310635:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758800640:12345-0@lo:101: 00010000:00010000:0.0:1790895320.310644:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895320.310662:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8583 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.310683:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8583 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.310694:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8583 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.310702:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7dc00, rc 0) 00000100:00100000:0.0:1790895320.310733:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758800640:12345-0@lo:101: Request processed in 99us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895320.310738:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1790895320.310766:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758800640:0@lo:101: 00010000:00010000:0.0:1790895320.310778:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.310786:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895320.310847:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758800768:0@lo:501: 00000100:00100000:0.0:1790895320.310921:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895320.310935:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861b240 going to sleep for 11 seconds 00000100:00100000:0.0:1790895320.310949:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800768 00000100:00100000:0.0:1790895320.310953:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800768 00000100:00100000:0.0:1790895320.310972:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790895320.310978:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758800768:12345-0@lo:501: 00000100:00100000:0.0:1790895320.311196:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758800768:12345-0@lo:501: Request processed in 217us (273us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790895320.311231:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790895320.311276:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758800768:0@lo:501: 10000000:01000000:0.0:1790895320.311295:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790895320.311300:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895320.311308:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895320.311409:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758800512:12345-0@lo:400: Request processed in 2418us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895320.311418:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790895320.311462:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf336be6680 x1877889758800512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895320.311473:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758800512:0@lo:400: 00010000:00080000:2.0:1790895320.311485:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf336be6d80 x1877889758800384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895336 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895320.311506:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758800384:0@lo:400: 00000100:00100000:3.0:1790895320.315839:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877889758800128:12345-0@lo:8: Request processed in 6590us (7533us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895320.315880:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790895320.318148:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf336be7b80 x1877889758800128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790895330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895320.318163:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790895320.318175:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1790895320.318185:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1790895320.318191:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1790895320.318195:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf332954800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1790895320.318268:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1790895320.318276:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758800128:0@lo:8: 00000004:00080000:2.0:1790895320.319024:0:6874:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790895320.319169:0:6874:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 193286310595ns, next at 0ns, rc = 0 00000004:00080000:3.0:1790895320.449020:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1790895320.490546:0:6875:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1790895320.490583:0:6875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801024:0@lo:7: 00000100:00100000:3.0:1790895320.490666:0:6875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.490719:0:6875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e33c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895320.490755:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758800896:0@lo:13: 00000100:00100000:3.0:1790895320.490782:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.490823:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801024 00000100:00100000:3.0:1790895320.490833:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801024 00000100:00100000:3.0:1790895320.490919:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790895320.490940:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6875:x1877889758801024:12345-0@lo:7: 00000100:00080000:2.0:1790895320.494133:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895320.494172:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758800896 00000100:00100000:2.0:1790895320.494184:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758800896 00000100:00100000:2.0:1790895320.494240:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895320.494252:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877889758800896:12345-0@lo:13: 00002000:00000024:2.0:1790895320.494289:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1790895320.494394:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1877889758800896:12345-0@lo:13: Request processed in 145us (3611us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895320.494401:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790895320.494482:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3031f5c00 x1877889758800896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895336 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895320.494506:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758800896:0@lo:13: 00002000:00080000:3.0:1790895320.500414:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1790895320.500423:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1790895320.500538:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6875:x1877889758801024:12345-0@lo:7: Request processed in 9594us (9868us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895320.500548:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790895320.500826:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3031f4700 x1877889758801024/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790895336 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895320.500842:0:6875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801024:0@lo:7: 00000004:00080000:2.0:1790895320.500879:0:6875:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1790895320.500934:0:6875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801152:0@lo:5: 00000100:00100000:2.0:1790895320.500969:0:6875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895320.501161:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801152 00000100:00100000:1.0:1790895320.501168:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801152 00000100:00100000:1.0:1790895320.501212:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790895320.501221:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6875:x1877889758801152:12345-0@lo:5: 00002000:00080000:1.0:1790895320.501247:0:6688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1790895320.501251:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1790895320.501530:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6875:x1877889758801152:12345-0@lo:5: Request processed in 310us (560us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1790895320.501537:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790895320.501594:0:6875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31003f540 going to sleep for 11 seconds 00010000:00080000:2.0:1790895320.501612:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf336be6d80 x1877889758801152/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790895336 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895320.501625:0:6875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801152:0@lo:5: 00000004:00080000:2.0:1790895320.501635:0:6875:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1790895320.501661:0:6875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801280:0@lo:700: 00000100:00100000:2.0:1790895320.501693:0:6875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895320.501720:0:6875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31003f540 going to sleep for 11 seconds 00000100:00100000:1.0:1790895320.501788:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801280 00000100:00100000:1.0:1790895320.501792:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801280 00000100:00100000:1.0:1790895320.501826:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895320.501834:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6875:x1877889758801280:12345-0@lo:700: 00000100:00100000:1.0:1790895320.501890:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1877889758801408:0@lo:700: 00000100:00100000:1.0:1790895320.501931:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895320.501948:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3074fa0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895320.502446:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801408 00000100:00100000:0.0:1790895320.502453:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801408 00000100:00100000:0.0:1790895320.502492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895320.502501:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1877889758801408:12345-0@lo:700: 40000000:02000000:0.0:1790895320.536208:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1790895320.546143:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6697:x1877889758801408:12345-0@lo:700: Request processed in 43633us (44201us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895320.546163:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1790895320.546381:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3397f1880 x1877889758801408/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790895336 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895320.546398:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6697:1877889758801408:0@lo:700: 40000000:02000000:0.0:1790895320.546411:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:1.0:1790895320.645945:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1790895320.645963:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1790895320.646193:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6875:x1877889758801280:12345-0@lo:700: Request processed in 144356us (144494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895320.646209:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790895320.646305:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf336be6300 x1877889758801280/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790895336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895320.646317:0:6875:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1790895320.646333:0:6875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801280:0@lo:700: 00000004:02000040:3.0:1790895320.705596:0:6875:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1790895320.711369:0:6875:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801536:0@lo:5: 00000100:00100000:3.0:1790895320.711440:0:6875:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895320.711929:0:6875:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3780 going to sleep for 11 seconds 00000100:00100000:0.0:1790895320.716080:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801536 00000100:00100000:0.0:1790895320.716096:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801536 00000100:00100000:1.0:1790895320.718298:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790895320.718314:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6875:x1877889758801536:12345-0@lo:5: 00002000:00080000:1.0:1790895320.729293:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1790895320.729316:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1790895320.739139:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6875:x1877889758801536:12345-0@lo:5: Request processed in 20821us (27690us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1790895320.739152:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1790895320.739365:0:6875:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3031f6d80 x1877889758801536/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790895336 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895320.739383:0:6875:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f6d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6875:1877889758801536:0@lo:5: 00000004:00080000:0.0:1790895320.739405:0:6875:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1790895320.794666:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895321.822373:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895322.843037:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790895323.555300:0:7058:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790895323.864801:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895324.889204:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895325.656152:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895325.656185:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758801664:0@lo:13: 00000100:00100000:0.0:1790895325.656259:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895325.656362:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801664 00000100:00100000:0.0:1790895325.656370:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801664 00000100:00100000:0.0:1790895325.656446:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790895325.656449:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895325.656458:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877889758801664:12345-0@lo:13: 00002000:00000024:0.0:1790895325.656504:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895325.656563:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877889758801664:12345-0@lo:13: Request processed in 107us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895325.656569:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790895325.656778:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf338c21180 x1877889758801664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895341 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895325.656799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758801664:0@lo:13: 00000100:00100000:3.0:1790895325.663151:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895325.663180:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758801792:0@lo:400: 00000100:00100000:3.0:1790895325.663267:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895325.663331:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801792 00000100:00100000:3.0:1790895325.663341:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801792 00000100:00100000:3.0:1790895325.663392:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790895325.663401:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:3311:x1877889758801792:12345-0@lo:400: 00000100:00100000:3.0:1790895325.663460:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:3311:x1877889758801792:12345-0@lo:400: Request processed in 61us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895325.663468:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790895325.663513:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758801792:0@lo:400: 00000100:00100000:3.0:1790895325.663544:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758801920:0@lo:400: 00000100:00100000:3.0:1790895325.663908:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895325.663962:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758801920 00000100:00100000:3.0:1790895325.663966:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758801920 00000100:00100000:3.0:1790895325.663994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790895325.664001:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758801920:12345-0@lo:400: 00000100:00100000:3.0:1790895325.664050:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758801920:12345-0@lo:400: Request processed in 49us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895325.664056:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790895325.664085:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3031f6680 x1877889758801920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895325.664096:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758801920:0@lo:400: 00000100:00100000:3.0:1790895325.664131:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758802048:0@lo:400: 00000100:00100000:3.0:1790895325.664156:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895325.664185:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802048 00000100:00100000:3.0:1790895325.664190:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802048 00000100:00100000:3.0:1790895325.664219:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895325.664226:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758802048:12345-0@lo:400: 00000100:00100000:3.0:1790895325.664257:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758802048:12345-0@lo:400: Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895325.664263:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1790895325.664288:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790895325.664307:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3031f6680 x1877889758802048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895341 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895325.664316:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758802048:0@lo:400: 00000001:00080000:3.0:1790895325.748091:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1790895325.912104:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895326.948365:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895327.965729:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895328.990638:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895330.009031:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895330.776662:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758802176:0@lo:13: 00000100:00100000:3.0:1790895330.776732:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895330.776932:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802176 00000100:00100000:0.0:1790895330.776940:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802176 00000100:00100000:0.0:1790895330.776994:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895330.777003:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758802176:12345-0@lo:13: 00002000:00000024:0.0:1790895330.777037:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895330.777079:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758802176:12345-0@lo:13: Request processed in 77us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895330.777087:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895330.777111:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758802432:0@lo:400: 00000100:00100000:0.0:1790895330.777153:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895330.777176:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790895330.777182:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758802304:0@lo:400: 00000100:00100000:0.0:1790895330.777208:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790895330.777236:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895330.777271:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802432 00000100:00100000:0.0:1790895330.777275:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802432 00000100:00100000:0.0:1790895330.777301:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790895330.777308:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758802432:12345-0@lo:400: 00000100:00100000:0.0:1790895330.777354:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758802432:12345-0@lo:400: Request processed in 46us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895330.777360:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790895330.777379:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802304 00000100:00100000:0.0:1790895330.777383:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802304 00000100:00100000:0.0:1790895330.777405:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790895330.777411:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:3311:x1877889758802304:12345-0@lo:400: 00000100:00100000:0.0:1790895330.777436:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:3311:x1877889758802304:12345-0@lo:400: Request processed in 25us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895330.777440:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790895330.777466:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758802560:0@lo:400: 00000100:00100000:0.0:1790895330.777486:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895330.777511:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802560 00000100:00100000:0.0:1790895330.777515:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802560 00000100:00100000:0.0:1790895330.777536:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790895330.777541:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758802560:12345-0@lo:400: 00000100:00100000:0.0:1790895330.777568:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758802560:12345-0@lo:400: Request processed in 26us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895330.777582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790895330.777594:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790895330.777615:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf338c22a00 x1877889758802560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895330.777628:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758802560:0@lo:400: 00000100:00100000:0.0:1790895330.777653:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758802304:0@lo:400: 00010000:00080000:0.0:1790895330.777662:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf338c22d80 x1877889758802432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895346 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895330.777671:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758802432:0@lo:400: 00010000:00080000:0.0:1790895330.777700:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3031f6680 x1877889758802176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895346 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895330.777708:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1790895330.777721:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758802176:0@lo:13: 00010000:00010000:1.0:1790895331.036312:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895332.056080:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895333.085392:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895334.109216:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790895335.056535:0:7623:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790895335.056539:0:7623:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1790895335.056785:0:7623:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cf332953800 00000020:01000004:2.0:1790895335.056802:0:7623:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1790895335.056814:0:7623:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1790895335.056829:0:7623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cf3031a99c0) 00000020:00000080:2.0:1790895335.056846:0:7623:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790895335.080584:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1790895335.081009:0:7623:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00010000:00010000:0.0:1790895335.129719:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1790895335.138079:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1790895335.149724:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1790895335.149760:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1790895335.149818:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1790895335.149836:0:7623:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1790895335.150589:0:7623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1790895335.150601:0:7623:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790895335.150614:0:7623:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7911a98710cf8598 00000020:01000004:3.0:1790895335.150622:0:7623:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1790895335.150645:0:7623:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.154@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1790895335.150648:0:7623:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1790895335.150654:0:7623:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1790895335.150674:0:7623:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1790895335.150677:0:7623:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790895335.179549:0:7623:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790895335.179597:0:7623:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.154@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1790895335.179601:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790895335.179672:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790895335.179674:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790895335.179675:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790895335.179677:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790895335.179678:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790895335.179679:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790895335.179681:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790895335.179682:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790895335.179683:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790895335.179685:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790895335.179689:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1790895335.179696:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790895335.179697:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790895335.179698:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790895335.179699:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790895335.179700:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790895335.179700:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790895335.179701:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790895335.179702:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1790895335.179703:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1790895335.179704:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790895335.179704:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790895335.179731:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790895335.179810:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758802688:0@lo:253: 00000100:00100000:2.0:1790895335.180208:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.180271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802688 00000100:00100000:3.0:1790895335.180281:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802688 00000100:00100000:3.0:1790895335.180478:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790895335.180487:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:7623:x1877889758802688:12345-0@lo:253: 20000000:01000000:3.0:1790895335.180519:0:5825:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1790895335.180525:0:5825:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1790895335.180530:0:5825:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1790895335.180533:0:5825:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000100:00100000:1.0:1790895335.180687:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b9c0 going to sleep for 11 seconds 00000040:00080000:1.0:1790895335.182332:0:5825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790895335.182547:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1790895335.182562:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1790895335.182602:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1790895335.182692:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1790895335.182731:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1790895335.182973:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1790895335.183525:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1790895335.183545:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:1.0:1790895335.183547:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:1.0:1790895335.183583:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1790895335.183591:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1790895335.183718:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1790895335.183727:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:1.0:1790895335.183836:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1790895335.183849:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790895335.183985:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1790895335.184067:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1790895335.185556:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1790895335.185585:0:5825:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.154@tcp 20000000:01000000:1.0:1790895335.185587:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.154@tcp (null) (null) (null) 00000040:00080000:1.0:1790895335.185697:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1790895335.185706:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1790895335.186273:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1790895335.186284:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.154@tcp (null) (null) 00000040:00080000:1.0:1790895335.186319:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1790895335.186329:0:5825:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1790895335.186381:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1790895335.186577:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1790895335.186600:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1790895335.186816:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1790895335.186820:0:5825:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1790895335.186835:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790895335.186838:0:5825:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1790895335.186950:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1790895335.186953:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790895335.188364:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1790895335.188440:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1790895335.188498:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1790895335.189336:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1790895335.189377:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1790895335.189450:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1790895335.189463:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790895335.189466:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1790895335.198799:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1790895335.199521:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1790895335.199568:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1790895335.199718:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1790895335.199733:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790895335.199736:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1790895335.201532:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1790895335.202685:0:7627:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1790895335.202973:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1790895335.203480:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1790895335.203521:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1790895335.203552:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1790895335.203564:0:5825:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790895335.203567:0:5825:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1790895335.206270:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1790895335.206380:0:7628:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1790895335.206417:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1790895335.207111:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1790895335.207231:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1790895335.207305:0:5825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1790895335.207325:0:5825:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1790895335.207337:0:5825:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1790895335.207348:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790895335.207369:0:5825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207387:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207395:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8513 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207403:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf853d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207409:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8559 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207416:0:5825:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8583 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207423:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207465:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8583 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207493:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8583 expref: 16 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895335.207508:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758802816:0@lo:104: 00000100:00100000:0.0:1790895335.207577:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895335.207676:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8559 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207690:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8559 expref: 16 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895335.207699:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758802944:0@lo:104: 00010000:00010000:0.0:1790895335.207728:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf853d expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207736:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf853d expref: 16 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895335.207744:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758803072:0@lo:104: 00010000:00010000:0.0:1790895335.207782:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8513 expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207790:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8513 expref: 16 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895335.207797:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758803200:0@lo:104: 00010000:00010000:0.0:1790895335.207820:0:5825:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 16 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.207828:0:5825:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 16 pid: 5826 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895335.207835:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758803328:0@lo:104: 00000100:00100000:0.0:1790895335.207853:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895335.208387:0:5815:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790895335.208410:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.208483:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.208540:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.208560:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802816 00000100:00100000:3.0:1790895335.208568:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802816 00000100:00100000:3.0:1790895335.208668:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758802944 00000100:00100000:3.0:1790895335.208672:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758802944 00000100:00100000:3.0:1790895335.208687:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803072 00000100:00100000:3.0:1790895335.208689:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803072 00000100:00100000:3.0:1790895335.208702:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895335.208711:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+5:5825:x1877889758802816:12345-0@lo:104: 00010000:00010000:3.0:1790895335.208725:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.208820:0:5815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.208830:0:5815:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1790895335.208836:0:5815:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:3.0:1790895335.211094:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790895335.211109:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+5:5825:x1877889758802816:12345-0@lo:104: Request processed in 2397us (3529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.211120:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790895335.211424:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803200 00000100:00100000:2.0:1790895335.211433:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803200 00000100:00100000:2.0:1790895335.211465:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803328 00000100:00100000:2.0:1790895335.211467:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803328 00000100:00100000:2.0:1790895335.211479:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895335.211486:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+7:5825:x1877889758802944:12345-0@lo:104: 00010000:00010000:2.0:1790895335.211501:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.211550:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790895335.211555:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+7:5825:x1877889758802944:12345-0@lo:104: Request processed in 70us (3145us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895335.211562:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895335.211579:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790895335.211585:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+6:5825:x1877889758803072:12345-0@lo:104: 00010000:00010000:2.0:1790895335.211592:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.212938:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790895335.212952:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.212964:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ce00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895335.212968:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.212978:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895335.212987:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895335.212993:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895335.213045:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213052:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895335.213078:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213086:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf8583 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf858a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213115:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895335.213119:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213124:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cb400 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895335.213127:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213243:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895335.213250:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895335.213256:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895335.213281:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213287:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895335.213304:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213311:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb400/0x7911a98710cf8559 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8560 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213322:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.213324:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.213325:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895335.213343:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758803456:0@lo:103: 00000100:00100000:3.0:1790895335.213591:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.213654:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758803584:0@lo:103: 00000100:00100000:3.0:1790895335.213678:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.213712:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803456 00000100:00100000:3.0:1790895335.213718:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803456 00010000:00010000:3.0:1790895335.213742:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8583 expref: 17 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.213778:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803584 00000100:00100000:3.0:1790895335.213781:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803584 00010000:00010000:3.0:1790895335.213794:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8559 expref: 18 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.213806:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895335.213814:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+18:3309:x1877889758803456:12345-0@lo:103: 00010000:00010000:3.0:1790895335.213826:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895335.213830:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8583 expref: 18 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213852:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8583 expref: 18 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213884:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895335.213925:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+18:3309:x1877889758803456:12345-0@lo:103: Request processed in 111us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.213932:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895335.213949:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790895335.213955:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+17:3310:x1877889758803584:12345-0@lo:103: 00010000:00010000:3.0:1790895335.213962:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895335.213975:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8559 expref: 17 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213986:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8559 expref: 17 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.213994:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895335.214021:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+17:3310:x1877889758803584:12345-0@lo:103: Request processed in 66us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.214027:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790895335.214065:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758803456:0@lo:103: 00000100:00100000:3.0:1790895335.214090:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758803584:0@lo:103: 00000100:00100000:0.0:1790895335.214238:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790895335.214245:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+5:5825:x1877889758803200:12345-0@lo:104: 00010000:00010000:0.0:1790895335.214256:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.214319:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790895335.214324:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+5:5825:x1877889758803200:12345-0@lo:104: Request processed in 80us (5784us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.214331:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790895335.214346:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790895335.214353:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+4:5825:x1877889758803328:12345-0@lo:104: 00010000:00010000:0.0:1790895335.214360:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.214397:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790895335.214402:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+4:5825:x1877889758803328:12345-0@lo:104: Request processed in 51us (5583us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.214408:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1790895335.214512:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790895335.214517:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214525:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029ca000 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895335.214528:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214541:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895335.214548:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895335.214554:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895335.214582:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214603:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895335.214616:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214623:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8513 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf851a expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214635:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895335.214638:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214644:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf301523000 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895335.214647:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214654:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895335.214660:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895335.214665:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895335.214678:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214685:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895335.214700:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214706:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf301523000/0x7911a98710cf84e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf84f0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214722:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.214724:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.214725:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.214730:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895335.214740:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758803712:0@lo:103: 00010000:00010000:2.0:1790895335.214750:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790895335.214757:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+3:5825:x1877889758803072:12345-0@lo:104: Request processed in 3173us (6273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895335.214765:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790895335.214767:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790895335.214782:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895335.214787:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.214793:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cb000 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895335.214796:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.214803:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758803840:0@lo:103: 00010000:00010000:2.0:1790895335.214803:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.214823:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1790895335.214823:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895335.214829:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895335.214846:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895335.214850:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.214852:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803712 00010000:00010000:2.0:1790895335.214873:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790895335.214875:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803712 00010000:00010000:2.0:1790895335.214884:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.214890:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf853d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8544 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214892:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8513 expref: 17 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.214907:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803840 00000100:00100000:3.0:1790895335.214910:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803840 00010000:00010000:2.0:1790895335.214916:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895335.214918:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895335.214919:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.214921:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 18 pid: 5826 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.214932:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790895335.214938:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+18:3311:x1877889758803712:12345-0@lo:103: 00010000:00010000:2.0:1790895335.214941:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf858a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8583 expref: 18 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.214945:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895335.214949:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8513 expref: 17 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.214950:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758802816:0@lo:104: 00010000:00010000:3.0:1790895335.214958:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8513 expref: 17 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.214960:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8560 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8559 expref: 17 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.214969:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758802944:0@lo:104: 00000100:00100000:2.0:1790895335.214976:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758803072:0@lo:104: 00010000:00010000:3.0:1790895335.214979:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895335.214982:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf851a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8513 expref: 16 pid: 5825 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.214992:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758803200:0@lo:104: 00000100:00100000:3.0:1790895335.215005:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+15:3311:x1877889758803712:12345-0@lo:103: Request processed in 68us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.215012:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790895335.215026:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790895335.215031:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+14:3308:x1877889758803840:12345-0@lo:103: 00010000:00010000:3.0:1790895335.215038:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895335.215042:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 14 pid: 5826 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215050:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 14 pid: 5826 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215060:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895335.215083:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+14:3308:x1877889758803840:12345-0@lo:103: Request processed in 52us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.215088:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1790895335.215110:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758803968:0@lo:103: 00000100:00100000:3.0:1790895335.215144:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.215183:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758803840:0@lo:103: 00000100:00100000:3.0:1790895335.215199:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758803968 00000100:00100000:3.0:1790895335.215202:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758803968 00010000:00010000:3.0:1790895335.215215:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf853d expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.215233:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790895335.215238:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+14:3309:x1877889758803968:12345-0@lo:103: 00010000:00010000:3.0:1790895335.215251:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895335.215256:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf853d expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215286:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf853d expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215296:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301522a00/0x7911a98710cf8544 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf853d expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215309:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215318:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215334:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215340:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215347:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215353:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215358:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895335.215362:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215380:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215389:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.215396:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301522200/0x7911a98710cf84f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf84e9 expref: 13 pid: 5826 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.215398:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895335.215407:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5825:1877889758803328:0@lo:104: 00000100:00100000:3.0:1790895335.215424:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+12:3309:x1877889758803968:12345-0@lo:103: Request processed in 186us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.215430:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1790895335.215433:0:5825:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.215442:0:5825:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.215449:0:5825:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.215453:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758803712:0@lo:103: 00010000:00010000:2.0:1790895335.215456:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf859f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.215470:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758803968:0@lo:103: 20000000:01000000:2.0:1790895335.215470:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1790895335.281647:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+11:7623:x1877889758802688:12345-0@lo:253: Request processed in 101151us (101430us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895335.281664:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790895335.281748:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758802688:0@lo:253: 10000000:01000000:1.0:1790895335.281781:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790895335.281785:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790895335.281787:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790895335.281788:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895335.281789:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1790895335.281791:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895335.281792:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895335.281793:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790895335.281795:0:7623:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1790895335.281797:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895335.281798:0:7623:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790895335.281822:0:7623:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf332953800 from lustre-OST0001 10000000:01000000:1.0:1790895335.281843:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1790895335.281845:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790895335.281852:0:7623:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf3031ab380 local copy 10000000:01000000:1.0:1790895335.281881:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790895335.281983:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.281993:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.281999:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895335.282013:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804096:0@lo:101: 00000100:00100000:1.0:1790895335.282047:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895335.282117:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b180 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.282218:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804096 00000100:00100000:0.0:1790895335.282224:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804096 00000100:00100000:0.0:1790895335.282342:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1790895335.282352:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+11:7623:x1877889758804096:12345-0@lo:101: 00010000:00010000:0.0:1790895335.282366:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895335.282380:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf85ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf85a6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.282403:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf85ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf85a6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.282414:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf85ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf85a6 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.282432:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c800, rc 0) 00000100:00100000:0.0:1790895335.282469:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804096:12345-0@lo:101: Request processed in 118us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.282475:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790895335.282829:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804096:0@lo:101: 00010000:00010000:1.0:1790895335.282840:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.282855:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895335.282971:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804224:0@lo:501: 00000100:00100000:1.0:1790895335.282993:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895335.283018:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790895335.283035:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804224 00000100:00100000:2.0:1790895335.283041:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804224 00000100:00100000:2.0:1790895335.283077:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1790895335.283085:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804224:12345-0@lo:501: 00000100:00100000:2.0:1790895335.283384:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804224:12345-0@lo:501: Request processed in 300us (389us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790895335.283393:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790895335.283470:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804224:0@lo:501: 10000000:01000000:1.0:1790895335.283484:0:7623:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1790895335.283510:0:7623:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1790895335.283516:0:7623:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.283526:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.283535:0:7623:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.283602:0:7623:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790895335.283628:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf332953800 10000000:01000000:1.0:1790895335.283634:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790895335.283641:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1790895335.283644:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790895335.283648:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1790895335.283651:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790895335.283670:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.283683:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.283689:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895335.283698:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804352:0@lo:101: 00000100:00100000:1.0:1790895335.283722:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895335.283747:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908be40 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.283806:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804352 00000100:00100000:0.0:1790895335.283810:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804352 00000100:00100000:0.0:1790895335.283841:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790895335.283846:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804352:12345-0@lo:101: 00010000:00010000:0.0:1790895335.283853:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895335.283876:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf85b4 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.283888:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.283894:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.283907:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d600, rc 0) 00000100:00100000:0.0:1790895335.283939:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758804352:12345-0@lo:101: Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.283944:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790895335.283971:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804352:0@lo:101: 00010000:00010000:1.0:1790895335.283982:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.283989:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895335.284046:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804480:0@lo:501: 00000100:00100000:1.0:1790895335.284071:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.284109:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804480 00000100:00100000:1.0:1790895335.284110:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908be40 going to sleep for 11 seconds 00000100:00100000:2.0:1790895335.284113:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804480 00010000:00010000:3.0:1790895335.284228:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895335.284234:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.284239:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895335.284242:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.284247:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895335.284252:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895335.284264:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895335.284289:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.284302:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895335.284332:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.284340:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf30167c400/0x7911a98710cf85a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7911a98710cf85ad expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.284354:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.284355:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.284357:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895335.284366:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895335.284377:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758804608:0@lo:103: 00000100:00100000:2.0:1790895335.284389:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790895335.284396:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758804480:12345-0@lo:501: 00000100:00100000:3.0:1790895335.284406:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.284434:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804608 00000100:00100000:3.0:1790895335.284438:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804608 00000100:00100000:3.0:1790895335.284468:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790895335.284474:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+14:3311:x1877889758804608:12345-0@lo:103: 00010000:00010000:3.0:1790895335.284484:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895335.284497:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf85ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf85a6 expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.284506:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895335.284532:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+13:3311:x1877889758804608:12345-0@lo:103: Request processed in 58us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.284538:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790895335.284567:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758804608:0@lo:103: 00000100:00100000:2.0:1790895335.284568:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804480:12345-0@lo:501: Request processed in 172us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895335.284583:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790895335.284698:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804480:0@lo:501: 00000100:00100000:2.0:1790895335.284729:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804736:0@lo:503: 00000100:00100000:2.0:1790895335.284764:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.284780:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.284801:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804736 00000100:00100000:0.0:1790895335.284805:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804736 00000100:00100000:0.0:1790895335.284879:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790895335.284887:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804736:12345-0@lo:503: 00000100:00100000:0.0:1790895335.285044:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804736:12345-0@lo:503: Request processed in 158us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.285057:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790895335.285078:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804736:0@lo:503: 00000040:00080000:2.0:1790895335.289852:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790895335.290013:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804864:0@lo:502: 00000100:00100000:2.0:1790895335.290106:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.290163:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895335.290193:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804864 00000100:00100000:3.0:1790895335.290211:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804864 00000100:00100000:3.0:1790895335.290276:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790895335.290285:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804864:12345-0@lo:502: 00000100:00100000:3.0:1790895335.290498:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804864:12345-0@lo:502: Request processed in 214us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.290507:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790895335.290599:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804864:0@lo:502: 00000040:00080000:1.0:1790895335.290879:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1790895335.290915:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1790895335.290933:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1790895335.290957:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1790895335.290975:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1790895335.290990:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1790895335.291007:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804992:0@lo:502: 00000100:00100000:1.0:1790895335.291040:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895335.291058:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908be40 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.291087:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758804992 00000100:00100000:0.0:1790895335.291093:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758804992 00000100:00100000:0.0:1790895335.291126:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790895335.291134:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804992:12345-0@lo:502: 00000100:00100000:0.0:1790895335.291281:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758804992:12345-0@lo:502: Request processed in 148us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.291518:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1790895335.291580:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758804992:0@lo:502: 00000040:00080000:1.0:1790895335.291657:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1790895335.291667:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1790895335.292241:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790895335.292250:0:7631:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790895335.292267:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895335.292270:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790895335.292277:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790895335.292375:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cf3031acd40) 00000020:00000080:2.0:1790895335.292398:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790895335.292405:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790895335.292463:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf332953800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790895335.292472:0:7631:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790895335.292479:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7911a98710cf85c9 00010000:00010000:2.0:1790895335.296828:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1790895335.297381:0:7631:0:(tgt_lastrcvd.c:1879:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1790895335.299942:0:7631:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1790895335.300233:0:7631:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1790895335.304518:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1790895335.305274:0:7631:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1790895335.317551:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1790895335.317565:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895335.317571:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895335.317573:0:7631:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1790895335.317577:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895335.317581:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895335.317582:0:7631:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1790895335.317585:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1790895335.317588:0:7631:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1790895335.317639:0:7631:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895335.317642:0:7631:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895335.317644:0:7631:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1790895335.317647:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1790895335.317995:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1790895335.318023:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790895335.318045:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.318059:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895335.318068:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf332953800 from 1 10000000:01000000:0.0:1790895335.318071:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790895335.318110:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.318119:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.318130:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895335.318153:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805120:0@lo:101: 00000100:00100000:0.0:1790895335.318233:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895335.318290:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895335.318481:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758805120 00000100:00100000:1.0:1790895335.318489:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758805120 00000100:00100000:1.0:1790895335.326379:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1790895335.326398:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:7623:x1877889758805120:12345-0@lo:101: 00010000:00010000:1.0:1790895335.326419:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895335.326439:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf85d0 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.326468:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.326479:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.326504:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:1.0:1790895335.326651:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805120:12345-0@lo:101: Request processed in 258us (8417us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895335.326658:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790895335.327052:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805120:0@lo:101: 00010000:00010000:0.0:1790895335.327073:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.327083:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.327290:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805248:0@lo:501: 00000100:00100000:2.0:1790895335.327333:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.327407:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.327447:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758805248 00000100:00100000:0.0:1790895335.327455:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758805248 00000100:00100000:0.0:1790895335.327532:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1790895335.327542:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805248:12345-0@lo:501: 00000100:00100000:0.0:1790895335.327839:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805248:12345-0@lo:501: Request processed in 298us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.327847:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790895335.327961:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805248:0@lo:501: 00000100:00100000:2.0:1790895335.327992:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805376:0@lo:503: 00000100:00100000:2.0:1790895335.328041:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.328625:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895335.329112:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758805376 00000100:00100000:1.0:1790895335.329119:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758805376 00000100:00100000:1.0:1790895335.329153:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1790895335.329161:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805376:12345-0@lo:503: 00000100:00100000:1.0:1790895335.329554:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805376:12345-0@lo:503: Request processed in 393us (1511us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895335.329562:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790895335.329809:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805376:0@lo:503: 00000040:00080000:2.0:1790895335.330242:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790895335.330333:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805504:0@lo:502: 00000100:00100000:2.0:1790895335.330379:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.330416:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895335.330463:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758805504 00000100:00100000:1.0:1790895335.330468:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758805504 00000100:00100000:1.0:1790895335.330503:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1790895335.330510:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805504:12345-0@lo:502: 00000100:00100000:1.0:1790895335.330691:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805504:12345-0@lo:502: Request processed in 181us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895335.330698:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1790895335.330995:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805504:0@lo:502: 00000040:00080000:2.0:1790895335.331245:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1790895335.331306:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1790895335.331330:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805632:0@lo:502: 00000100:00100000:2.0:1790895335.331368:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.331406:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895335.331448:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758805632 00000100:00100000:1.0:1790895335.331454:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758805632 00000100:00100000:1.0:1790895335.331489:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1790895335.331496:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805632:12345-0@lo:502: 00000100:00100000:1.0:1790895335.331632:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805632:12345-0@lo:502: Request processed in 136us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895335.331639:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1790895335.331897:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805632:0@lo:502: 00000040:00080000:2.0:1790895335.331994:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1790895335.332004:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1790895335.332632:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895335.332646:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895335.332649:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790895335.332656:0:7635:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf332953800 00000020:00000080:1.0:1790895335.332658:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790895335.332680:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895335.332683:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895335.332685:0:7635:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1790895335.332687:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1790895335.332952:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1790895335.332973:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895335.332994:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.333006:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895335.333048:0:7623:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790895335.333051:0:7623:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf332953800 10000000:01000000:2.0:1790895335.333054:0:7623:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf332953800 10000000:01000000:2.0:1790895335.333063:0:7623:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790895335.333069:0:7623:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf332953800 from 1 10000000:01000000:2.0:1790895335.333071:0:7623:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790895335.333103:0:7623:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.333111:0:7623:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.333120:0:7623:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.333137:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805760:0@lo:101: 00000100:00100000:2.0:1790895335.333187:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.333230:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.333301:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758805760 00000100:00100000:0.0:1790895335.333308:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758805760 00000100:00100000:0.0:1790895335.333351:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1790895335.333361:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758805760:12345-0@lo:101: 00010000:00010000:0.0:1790895335.333373:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895335.333386:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf85de expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.333408:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf85de expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.333419:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf85de expref: 14 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.333436:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895335.333478:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758805760:12345-0@lo:101: Request processed in 118us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.333484:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790895335.333589:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805760:0@lo:101: 00010000:00010000:2.0:1790895335.333671:0:7623:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895335.333681:0:7623:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.333838:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805888:0@lo:501: 00000100:00100000:2.0:1790895335.333897:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.333919:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895335.333980:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758805888 00000100:00100000:1.0:1790895335.333986:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758805888 00000100:00100000:1.0:1790895335.334017:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1790895335.334024:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758805888:12345-0@lo:501: 00000100:00100000:1.0:1790895335.334250:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758805888:12345-0@lo:501: Request processed in 226us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895335.334268:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790895335.334332:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758805888:0@lo:501: 00000100:00100000:2.0:1790895335.334359:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758806016:0@lo:503: 00000100:00100000:2.0:1790895335.334398:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.334443:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.334504:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806016 00000100:00100000:0.0:1790895335.334509:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806016 00000100:00100000:0.0:1790895335.334539:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1790895335.334546:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758806016:12345-0@lo:503: 00000100:00100000:0.0:1790895335.334702:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758806016:12345-0@lo:503: Request processed in 156us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.334708:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790895335.335200:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758806016:0@lo:503: 00000040:00080000:2.0:1790895335.335483:0:7623:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1790895335.335546:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758806144:0@lo:502: 00000100:00100000:2.0:1790895335.335590:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895335.335819:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895335.336136:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806144 00000100:00100000:1.0:1790895335.336144:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806144 00000100:00100000:1.0:1790895335.336216:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790895335.336226:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758806144:12345-0@lo:502: 00000100:00100000:1.0:1790895335.336533:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758806144:12345-0@lo:502: Request processed in 309us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895335.336541:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1790895335.336816:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758806144:0@lo:502: 00000040:00080000:3.0:1790895335.337162:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1790895335.337219:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1790895335.337275:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1790895335.337325:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1790895335.337363:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1790895335.337413:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1790895335.337450:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1790895335.337483:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1790895335.337547:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1790895335.337587:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1790895335.337638:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1790895335.337689:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1790895335.337728:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1790895335.338231:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1790895335.338301:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1790895335.338359:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1790895335.338395:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1790895335.338445:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1790895335.338495:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1790895335.338531:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1790895335.338581:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1790895335.340878:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1790895335.340939:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1790895335.341038:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1790895335.341080:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1790895335.341115:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1790895335.341165:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1790895335.341204:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1790895335.341239:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1790895335.341303:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1790895335.341341:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1790895335.341395:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1790895335.341432:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1790895335.341500:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1790895335.341541:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1790895335.342016:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1790895335.342064:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1790895335.342115:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758806272:0@lo:502: 00000100:00100000:3.0:1790895335.342192:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.342299:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3030f8540 going to sleep for 11 seconds 00000100:00100000:0.0:1790895335.342347:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806272 00000100:00100000:0.0:1790895335.342355:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806272 00000100:00100000:0.0:1790895335.342440:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1790895335.342450:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758806272:12345-0@lo:502: 00000100:00100000:0.0:1790895335.342731:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758806272:12345-0@lo:502: Request processed in 281us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.342739:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1790895335.343053:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758806272:0@lo:502: 00000040:00080000:2.0:1790895335.343371:0:7623:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1790895335.343384:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:1.0:1790895335.344222:0:7636:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1790895335.344237:0:7636:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cf3077c4d40) 00000020:00000080:1.0:1790895335.344267:0:7636:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:1.0:1790895335.344349:0:7636:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf332953800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790895335.344353:0:7636:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf332953800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1790895335.344356:0:7636:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf332953800 3 00010000:00080000:1.0:1790895335.344391:0:7636:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf30fc30000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.154@tcp at head 00010000:00010000:1.0:1790895335.347251:0:7636:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1790895335.347553:0:7636:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1790895335.347592:0:7636:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790895335.347677:0:7636:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7911a98710cf85f3 00000100:00080000:1.0:1790895335.347690:0:7636:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790895335.347702:0:7636:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cf30fc30000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:1.0:1790895335.347742:0:7636:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf3397f3480 x1877889758806400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790895335.347899:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758806400:0@lo:38: 00000100:00100000:3.0:1790895335.347978:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895335.348092:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806400 00000100:00100000:0.0:1790895335.348101:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806400 00000100:00100000:0.0:1790895335.348137:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790895335.348146:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3307:x1877889758806400:12345-0@lo:38: 00010000:00080000:0.0:1790895335.348172:0:5832:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 208 last 0 00000020:00000080:0.0:1790895335.348203:0:5832:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7911a98710cf85fa 00000004:00100000:0.0:1790895335.348216:0:5832:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1790895335.348245:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8cf340faa000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1790895335.348337:0:7636:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790895335.348415:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790895335.348427:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758806528:0@lo:400: 00000100:00100000:1.0:1790895335.348457:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895335.349923:0:5833:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790895335.349937:0:5833:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1790895335.349949:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790895335.349959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806528 00000100:00100000:1.0:1790895335.349968:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806528 00000100:00100000:1.0:1790895335.350007:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1790895335.350017:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790895335.350026:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758806528:12345-0@lo:400: 00000100:00100000:1.0:1790895335.350106:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758806528:12345-0@lo:400: Request processed in 82us (1648us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895335.350113:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1790895335.350161:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3397f0e00 x1877889758806528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895335.350177:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758806528:0@lo:400: 00000100:00100000:3.0:1790895335.352900:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758806656:0@lo:400: 00000100:00100000:3.0:1790895335.352967:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.353003:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895335.353010:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758806784:0@lo:400: 00000100:00100000:3.0:1790895335.353048:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.353086:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806784 00000100:00100000:3.0:1790895335.353094:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806784 00000100:00100000:3.0:1790895335.353148:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790895335.353158:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758806784:12345-0@lo:400: 00000100:00100000:3.0:1790895335.353213:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758806784:12345-0@lo:400: Request processed in 56us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.353220:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790895335.353240:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1790895335.353281:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3397f3b80 x1877889758806784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895335.353296:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758806784:0@lo:400: 00000100:00100000:3.0:1790895335.353319:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790895335.353327:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806656 00000100:00100000:3.0:1790895335.353330:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806656 00000100:00100000:3.0:1790895335.353354:0:5831:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790895335.353360:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1790895335.353366:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758806656:12345-0@lo:400: 00000100:00100000:3.0:1790895335.353400:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758806656:12345-0@lo:400: Request processed in 35us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.353407:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1790895335.353421:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790895335.353436:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3397f3800 x1877889758806656/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895335.353445:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758806656:0@lo:400: 00000100:00100000:0.0:1790895335.355811:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877889758806400:12345-0@lo:38: Request processed in 7599us (7768us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895335.355825:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1790895335.356098:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:1.0:1790895335.356282:0:7638:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8cf3397f0e00 x1877889758806912/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895335.356306:0:7638:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b9c0 going to sleep for 0 seconds 00000020:01000000:0.0:1790895335.356464:0:7623:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1790895335.356489:0:7623:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790895335.357379:0:7623:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895335.357393:0:7623:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1790895335.357442:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1790895335.357444:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790895335.357446:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895335.357447:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895335.357448:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895335.357449:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895335.357451:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895335.357452:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895335.357454:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895335.357455:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895335.357456:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790895335.357460:0:7623:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1790895335.357463:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790895335.357464:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790895335.357465:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895335.357466:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895335.357467:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895335.357469:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895335.357469:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895335.357470:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895335.357472:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895335.357473:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895335.357474:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1790895335.357493:0:7623:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1790895335.357507:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758807040:0@lo:253: 00000100:00100000:0.0:1790895335.357585:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895335.357644:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895335.357993:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807040 00000100:00100000:2.0:1790895335.358001:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807040 00000100:00100000:2.0:1790895335.358055:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790895335.358065:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:7623:x1877889758807040:12345-0@lo:253: 20000000:01000000:2.0:1790895335.358091:0:5825:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790895335.358106:0:5825:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1790895335.358723:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3397f3480 x1877889758806400/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790895345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895335.358757:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790895335.358766:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1790895335.358773:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1790895335.358779:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790895335.358782:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf30fc30000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1790895335.358790:0:3307:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000075564535): req@ffff8cf3397f0e00 x1877889758806912/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895335.358808:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758806400:0@lo:38: 00000100:00100000:3.0:1790895335.358970:0:7638:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.359005:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758806912 00000100:00100000:3.0:1790895335.359009:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758806912 00000100:00100000:3.0:1790895335.359042:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790895335.359050:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1877889758806912:12345-0@lo:901: 00000100:00100000:3.0:1790895335.359342:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7638:x1877889758806912:12345-0@lo:901: Request processed in 292us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.359350:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1790895335.359370:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1790895335.359386:0:7638:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf3397f0e00 x1877889758806912/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1790895351 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895335.359396:0:7638:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7638:1877889758806912:0@lo:901: 20000000:01000000:0.0:1790895335.402230:0:5825:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1790895335.402298:0:5825:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1790895335.402644:0:5847:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1790895335.402650:0:5847:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1790895335.402681:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.402701:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf854b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.402710:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.402814:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf854b expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895335.402843:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf854b expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895335.402927:0:5847:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1877889758807168:0@lo:104: 00000100:00100000:1.0:1790895335.402993:0:5847:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895335.403093:0:5847:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b900 going to sleep for 11 seconds 00000100:00100000:3.0:1790895335.405655:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807168 00000100:00100000:3.0:1790895335.405679:0:5814:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807168 00000100:00100000:3.0:1790895335.405732:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790895335.405753:0:5814:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+3:5847:x1877889758807168:12345-0@lo:104: 00010000:00010000:3.0:1790895335.405771:0:5814:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.405892:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790895335.405899:0:5814:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:221ad158-1cb7-4652-832e-1e3667184cca+3:5847:x1877889758807168:12345-0@lo:104: Request processed in 159us (2907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.405906:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1790895335.405930:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895335.405937:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.405944:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cac00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895335.405949:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.405958:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895335.405966:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895335.405971:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1790895335.406024:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406032:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895335.406051:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406058:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf854b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8552 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406086:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.406088:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895335.406090:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895335.406114:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758807296:0@lo:103: 00000100:00100000:3.0:1790895335.406170:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.406222:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807296 00000100:00100000:3.0:1790895335.406227:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807296 00010000:00010000:3.0:1790895335.406247:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf854b expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.406284:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790895335.406291:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306506c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+15:3310:x1877889758807296:12345-0@lo:103: 00010000:00010000:3.0:1790895335.406301:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895335.406307:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf854b expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406331:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf854b expref: 15 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406349:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406358:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1790895335.406447:0:5816:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.013905391s 00010000:00010000:3.0:1790895335.406453:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406472:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406555:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406564:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406570:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895335.406575:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406584:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406594:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406605:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895335.406637:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306506c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+15:3310:x1877889758807296:12345-0@lo:103: Request processed in 348us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.406645:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790895335.406701:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758807296:0@lo:103: 00010000:00010000:3.0:1790895335.406732:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf8552 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf854b expref: 14 pid: 5824 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895335.406742:0:5847:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5847:1877889758807168:0@lo:104: 00010000:00010000:3.0:1790895335.406756:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406770:0:5847:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406777:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895335.406783:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8601 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5847 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895335.412056:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:7623:x1877889758807040:12345-0@lo:253: Request processed in 53985us (54464us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895335.412070:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1790895335.412198:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:221ad158-1cb7-4652-832e-1e3667184cca:7623:1877889758807040:0@lo:253: 10000000:01000000:0.0:1790895335.412213:0:7623:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1790895335.412216:0:7623:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790895335.412218:0:7623:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1790895335.412220:0:7623:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895335.412221:0:7623:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895335.412222:0:7623:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895335.412224:0:7623:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895335.412225:0:7623:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895335.412226:0:7623:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1790895335.412228:0:7623:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1790895335.412229:0:7623:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895335.412230:0:7623:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790895335.412244:0:7623:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1790895335.419010:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895335.419284:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1790895335.419603:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895335.419984:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790895335.420284:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895335.420621:0:7623:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790895335.424049:0:7623:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1790895335.695483:0:7623:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1790895335.695492:0:7623:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1790895335.695527:0:7623:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1790895335.695592:0:7623:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1790895335.695609:0:7623:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1790895335.695639:0:7623:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000100:00100000:1.0:1790895335.896355:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790895335.896396:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758807424:0@lo:13: 00000100:00100000:1.0:1790895335.896471:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895335.896581:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807424 00000100:00100000:3.0:1790895335.896590:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807424 00000100:00100000:3.0:1790895335.896654:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790895335.896666:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758807424:12345-0@lo:13: 00002000:00000024:3.0:1790895335.896702:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895335.896759:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758807424:12345-0@lo:13: Request processed in 95us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895335.896766:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1790895335.896794:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf201182a00 x1877889758807424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895351 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895335.896815:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758807424:0@lo:13: 00010000:00010000:2.0:1790895336.152696:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895337.178340:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895338.199989:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895339.224414:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895340.247994:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895340.505301:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790895340.510973:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758807680:0@lo:400: 00000100:00100000:1.0:1790895340.511067:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895340.511122:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758807552:0@lo:400: 00000100:00100000:1.0:1790895340.511148:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895340.511222:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807680 00000100:00100000:1.0:1790895340.511536:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807680 00000100:00100000:1.0:1790895340.511617:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790895340.511628:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758807680:12345-0@lo:400: 00000100:00100000:1.0:1790895340.511705:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758807680:12345-0@lo:400: Request processed in 78us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895340.511712:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790895340.511739:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807552 00000100:00100000:1.0:1790895340.511743:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807552 00000100:00100000:1.0:1790895340.511767:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1790895340.511773:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:3309:x1877889758807552:12345-0@lo:400: 00000100:00100000:1.0:1790895340.511803:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:3309:x1877889758807552:12345-0@lo:400: Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895340.511808:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1790895340.511884:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf336be5f80 x1877889758807680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895340.512015:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758807680:0@lo:400: 00000100:00100000:1.0:1790895340.512032:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758807552:0@lo:400: 00000100:00100000:2.0:1790895340.512293:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758807808:0@lo:400: 00000100:00100000:2.0:1790895340.512327:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895340.512352:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895340.512369:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758807936:0@lo:400: 00000100:00100000:2.0:1790895340.512396:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895340.512427:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807808 00000100:00100000:2.0:1790895340.512432:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807808 00000100:00100000:1.0:1790895340.512491:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790895340.512500:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758808064:0@lo:400: 00000100:00100000:1.0:1790895340.512528:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895340.515576:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808064 00000100:00100000:2.0:1790895340.515589:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808064 00000100:00100000:2.0:1790895340.515635:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895340.515645:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758807808:12345-0@lo:400: 00000100:00100000:2.0:1790895340.515741:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758807808:12345-0@lo:400: Request processed in 98us (3413us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895340.515748:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895340.515766:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790895340.515773:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758808064:12345-0@lo:400: 00000100:00100000:2.0:1790895340.515809:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758808064:12345-0@lo:400: Request processed in 37us (3280us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895340.515816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790895340.515835:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758807936 00000100:00100000:2.0:1790895340.515839:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758807936 00000100:00100000:2.0:1790895340.515885:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895340.515893:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758807936:12345-0@lo:400: 00000100:00100000:2.0:1790895340.515936:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758807936:12345-0@lo:400: Request processed in 45us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895340.515942:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790895340.515960:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790895340.515965:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790895340.516006:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf336be5c00 x1877889758807936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895340.516021:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758807936:0@lo:400: 00010000:00080000:2.0:1790895340.516330:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf336be7480 x1877889758807808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895340.516340:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758807808:0@lo:400: 00010000:00080000:2.0:1790895340.516384:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf336be5f80 x1877889758808064/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895356 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895340.516393:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758808064:0@lo:400: 10000000:01000000:3.0:1790895341.016348:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790895341.016356:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf310bbd000 from 30 10000000:01000000:3.0:1790895341.016363:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895341.016410:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.016422:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.016448:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.016471:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808192:0@lo:101: 00000100:00100000:3.0:1790895341.016555:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.016607:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:0.0:1790895341.016785:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808192 00000100:00100000:0.0:1790895341.016793:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808192 00000100:00100000:0.0:1790895341.016850:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790895341.016876:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758808192:12345-0@lo:101: 00010000:00010000:0.0:1790895341.016890:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895341.016903:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8608 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895341.016939:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8608 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895341.016949:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8608 expref: 14 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895341.016957:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895341.016999:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758808192:12345-0@lo:101: Request processed in 140us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.017005:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1790895341.017194:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808192:0@lo:101: 00010000:00010000:3.0:1790895341.017210:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.017349:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.017410:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808320:0@lo:501: 00000100:00100000:3.0:1790895341.017439:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.017472:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:0.0:1790895341.017591:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808320 00000100:00100000:0.0:1790895341.017597:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808320 00000100:00100000:0.0:1790895341.017631:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1790895341.017638:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758808320:12345-0@lo:501: 00000100:00100000:0.0:1790895341.018284:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758808320:12345-0@lo:501: Request processed in 642us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.018293:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1790895341.018398:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808320:0@lo:501: 00000100:00100000:3.0:1790895341.018436:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808448:0@lo:503: 00000100:00100000:3.0:1790895341.018481:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.018527:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.018543:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808448 00000100:00100000:3.0:1790895341.018548:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808448 00000100:00100000:3.0:1790895341.018577:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790895341.018584:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758808448:12345-0@lo:503: 00000100:00100000:3.0:1790895341.019632:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758808448:12345-0@lo:503: Request processed in 1044us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.019773:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1790895341.019830:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808448:0@lo:503: 00000100:00100000:3.0:1790895341.021736:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758808576:0@lo:13: 00000100:00100000:3.0:1790895341.021801:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.022012:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808576 00000100:00100000:3.0:1790895341.022021:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808576 00000100:00100000:3.0:1790895341.022381:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790895341.022390:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758808576:12345-0@lo:13: 00002000:00000024:3.0:1790895341.022425:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895341.022475:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758808576:12345-0@lo:13: Request processed in 86us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.022481:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1790895341.022953:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201180380 x1877889758808576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895341.022974:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758808576:0@lo:13: 00000100:00100000:3.0:1790895341.023312:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7917:1877889758808704:0@lo:502: 00000100:00100000:3.0:1790895341.023375:0:7917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.023412:0:7917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:0.0:1790895341.023502:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808704 00000100:00100000:0.0:1790895341.023508:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808704 00000100:00100000:0.0:1790895341.023545:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1790895341.023553:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:7917:x1877889758808704:12345-0@lo:502: 00000100:00100000:0.0:1790895341.023932:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:7917:x1877889758808704:12345-0@lo:502: Request processed in 379us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.023939:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790895341.026355:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7917:1877889758808704:0@lo:502: 00000100:00100000:3.0:1790895341.026439:0:7917:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7917:1877889758808832:0@lo:502: 00000100:00100000:3.0:1790895341.026518:0:7917:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.026563:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808832 00000100:00100000:3.0:1790895341.026569:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808832 00000100:00100000:3.0:1790895341.026616:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790895341.026631:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:7917:x1877889758808832:12345-0@lo:502: 00000100:00100000:3.0:1790895341.027024:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:7917:x1877889758808832:12345-0@lo:502: Request processed in 393us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.027104:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790895341.027740:0:7917:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.027766:0:7917:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7917:1877889758808832:0@lo:502: 00000040:00080000:3.0:1790895341.027795:0:7917:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790895341.027895:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790895341.027915:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790895341.027926:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.027938:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895341.027949:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1790895341.027952:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1790895341.027955:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1790895341.027987:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.027996:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.028007:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.028023:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808960:0@lo:101: 00000100:00100000:3.0:1790895341.028320:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.028352:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.028375:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758808960 00000100:00100000:3.0:1790895341.028381:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758808960 00000100:00100000:3.0:1790895341.028416:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790895341.028423:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758808960:12345-0@lo:101: 00010000:00010000:3.0:1790895341.028436:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895341.028449:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8616 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.028472:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8616 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.028483:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8616 expref: 15 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.028503:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029cb400, rc 0) 00000100:00100000:3.0:1790895341.030320:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758808960:12345-0@lo:101: Request processed in 1889us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.030331:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790895341.030401:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758808960:0@lo:101: 00010000:00010000:3.0:1790895341.030427:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.030441:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.030585:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809088:0@lo:501: 00000100:00100000:3.0:1790895341.030625:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.031429:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.031467:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809088 00000100:00100000:3.0:1790895341.031476:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809088 00000100:00100000:3.0:1790895341.031804:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790895341.031815:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758809088:12345-0@lo:501: 00000100:00100000:3.0:1790895341.032178:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758809088:12345-0@lo:501: Request processed in 364us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.032186:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1790895341.032976:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809088:0@lo:501: 00000100:00100000:3.0:1790895341.033036:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809216:0@lo:503: 00000100:00100000:3.0:1790895341.033091:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.033129:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217180 going to sleep for 11 seconds 00000100:00100000:0.0:1790895341.033406:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809216 00000100:00100000:0.0:1790895341.033413:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809216 00000100:00100000:0.0:1790895341.033454:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1790895341.033470:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758809216:12345-0@lo:503: 00000100:00100000:0.0:1790895341.034003:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758809216:12345-0@lo:503: Request processed in 534us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.034012:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1790895341.034129:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809216:0@lo:503: 00000100:00100000:0.0:1790895341.034708:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7918:1877889758809344:0@lo:502: 00000100:00100000:0.0:1790895341.034759:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.034796:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.034846:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809344 00000100:00100000:3.0:1790895341.034852:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809344 00000100:00100000:3.0:1790895341.034908:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790895341.034915:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+15:7918:x1877889758809344:12345-0@lo:502: 00000100:00100000:3.0:1790895341.035123:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+15:7918:x1877889758809344:12345-0@lo:502: Request processed in 207us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.035131:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1790895341.035359:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7918:1877889758809344:0@lo:502: 00000020:01000000:3.0:1790895341.035383:0:7918:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895341.035391:0:7918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895341.035393:0:7918:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790895341.035399:0:7918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790895341.035401:0:7918:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790895341.035418:0:7918:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7918:1877889758809472:0@lo:502: 00000100:00100000:3.0:1790895341.035460:0:7918:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.035573:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809472 00000100:00100000:0.0:1790895341.035579:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809472 00000100:00100000:0.0:1790895341.035603:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1790895341.035609:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:7918:x1877889758809472:12345-0@lo:502: 00000100:00100000:0.0:1790895341.035799:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:7918:x1877889758809472:12345-0@lo:502: Request processed in 189us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.035806:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1790895341.035896:0:7918:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2022179c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.035914:0:7918:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7918:1877889758809472:0@lo:502: 00000020:01000000:3.0:1790895341.035931:0:7918:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895341.035935:0:7918:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895341.035936:0:7918:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790895341.035940:0:7918:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1790895341.036082:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1790895341.036107:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790895341.036118:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895341.036129:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895341.036139:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1790895341.036151:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf303072000 from 30 10000000:01000000:0.0:1790895341.036154:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1790895341.036186:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895341.036207:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895341.036341:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895341.036357:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809600:0@lo:101: 00000100:00100000:0.0:1790895341.036387:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.036416:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8a80 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.036467:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809600 00000100:00100000:3.0:1790895341.036472:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809600 00000100:00100000:3.0:1790895341.036608:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790895341.036616:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758809600:12345-0@lo:101: 00010000:00010000:3.0:1790895341.036626:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895341.036638:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8624 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.036667:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8624 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.036678:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8624 expref: 16 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.036686:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029cb200, rc 0) 00000100:00100000:3.0:1790895341.036720:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758809600:12345-0@lo:101: Request processed in 106us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.036727:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1790895341.036899:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809600:0@lo:101: 00010000:00010000:3.0:1790895341.036911:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.036932:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.036975:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809728:0@lo:501: 00000100:00100000:3.0:1790895341.037000:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.037011:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790895341.037061:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809728 00000100:00100000:0.0:1790895341.037066:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809728 00000100:00100000:0.0:1790895341.037095:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1790895341.037102:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758809728:12345-0@lo:501: 00000100:00100000:0.0:1790895341.037456:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758809728:12345-0@lo:501: Request processed in 354us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.037463:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1790895341.037595:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809728:0@lo:501: 00000100:00100000:3.0:1790895341.037622:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809856:0@lo:503: 00000100:00100000:3.0:1790895341.037723:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.037787:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790895341.037840:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809856 00000100:00100000:0.0:1790895341.037844:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809856 00000100:00100000:0.0:1790895341.037947:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1790895341.037954:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758809856:12345-0@lo:503: 00000100:00100000:0.0:1790895341.038129:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758809856:12345-0@lo:503: Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.038137:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1790895341.038753:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758809856:0@lo:503: 00000100:00100000:1.0:1790895341.041899:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7919:1877889758809984:0@lo:502: 00000100:00100000:1.0:1790895341.041981:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895341.042020:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da840 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.042972:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758809984 00000100:00100000:3.0:1790895341.042983:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758809984 00000100:00100000:3.0:1790895341.043041:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1790895341.043051:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:7919:x1877889758809984:12345-0@lo:502: 00000100:00100000:3.0:1790895341.043474:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:7919:x1877889758809984:12345-0@lo:502: Request processed in 424us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.043484:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790895341.043736:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7919:1877889758809984:0@lo:502: 00000100:00100000:1.0:1790895341.043798:0:7919:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7919:1877889758810112:0@lo:502: 00000100:00100000:1.0:1790895341.043838:0:7919:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.043917:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758810112 00000100:00100000:3.0:1790895341.043922:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758810112 00000100:00100000:1.0:1790895341.043925:0:7919:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da840 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.043960:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1790895341.043967:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:7919:x1877889758810112:12345-0@lo:502: 00000100:00100000:3.0:1790895341.044129:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:7919:x1877889758810112:12345-0@lo:502: Request processed in 161us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.044136:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1790895341.044195:0:7919:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7919:1877889758810112:0@lo:502: 00000040:00080000:1.0:1790895341.044215:0:7919:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1790895341.044328:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1790895341.044345:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790895341.044354:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.044369:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895341.044379:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790895341.044382:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf303072000 from 5 10000000:01000000:3.0:1790895341.044385:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790895341.044411:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.044418:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.044438:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.044451:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810240:0@lo:101: 00000100:00100000:3.0:1790895341.044482:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.044523:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895341.044568:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758810240 00000100:00100000:1.0:1790895341.044573:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758810240 00000100:00100000:1.0:1790895341.044609:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790895341.044616:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758810240:12345-0@lo:101: 00010000:00010000:1.0:1790895341.044625:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895341.044649:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8639 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8632 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895341.044673:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8632 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895341.044682:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8639 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8632 expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895341.044691:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ca00, rc 0) 00000100:00100000:1.0:1790895341.044718:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758810240:12345-0@lo:101: Request processed in 103us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895341.044724:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1790895341.044855:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810240:0@lo:101: 00010000:00010000:3.0:1790895341.044908:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.044916:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.044979:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810368:0@lo:256: 00000100:00100000:3.0:1790895341.045011:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.045037:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895341.045314:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758810368 00000100:00100000:1.0:1790895341.045337:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758810368 00000100:00100000:1.0:1790895341.045372:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1790895341.045378:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758810368:12345-0@lo:256: 20000000:01000000:1.0:1790895341.045394:0:5826:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1790895341.045411:0:5826:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1790895341.045414:0:5826:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1790895341.045486:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758810368:12345-0@lo:256: Request processed in 107us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895341.045492:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1790895341.045560:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810368:0@lo:256: 10000000:01000000:3.0:1790895341.045603:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1790895341.045609:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.045617:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895341.045625:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1790895341.045626:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1790895341.045629:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790895341.045722:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.045731:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.045738:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.045750:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810496:0@lo:101: 00000100:00100000:3.0:1790895341.045775:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.045893:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895341.048388:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758810496 00000100:00100000:1.0:1790895341.048403:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758810496 00000100:00100000:1.0:1790895341.048464:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790895341.048474:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758810496:12345-0@lo:101: 00010000:00010000:1.0:1790895341.048490:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895341.048509:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8640 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895341.048537:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8640 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895341.048548:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8640 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895341.048557:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167da00, rc 0) 00000100:00100000:1.0:1790895341.048622:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758810496:12345-0@lo:101: Request processed in 150us (2845us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895341.048628:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1790895341.049435:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810496:0@lo:101: 00010000:00010000:3.0:1790895341.049471:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.049481:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.049546:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810624:0@lo:501: 00000100:00100000:3.0:1790895341.049587:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.049733:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895341.049976:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758810624 00000100:00100000:1.0:1790895341.049981:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758810624 00000100:00100000:1.0:1790895341.050065:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790895341.050073:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758810624:12345-0@lo:501: 00000100:00100000:1.0:1790895341.050345:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758810624:12345-0@lo:501: Request processed in 272us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895341.050352:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790895341.050415:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810624:0@lo:501: 00000100:00100000:3.0:1790895341.050447:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810752:0@lo:503: 00000100:00100000:3.0:1790895341.050552:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.050577:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217c00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.050591:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758810752 00000100:00100000:3.0:1790895341.050595:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758810752 00000100:00100000:3.0:1790895341.050616:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790895341.050622:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758810752:12345-0@lo:503: 00000100:00100000:3.0:1790895341.051061:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758810752:12345-0@lo:503: Request processed in 437us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.051068:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790895341.051195:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758810752:0@lo:503: 00000100:00100000:1.0:1790895341.051573:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7920:1877889758810880:0@lo:502: 00000100:00100000:1.0:1790895341.051611:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895341.051731:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180dab40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.051760:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758810880 00000100:00100000:3.0:1790895341.051766:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758810880 00000100:00100000:3.0:1790895341.051833:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790895341.051841:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:7920:x1877889758810880:12345-0@lo:502: 00000100:00100000:3.0:1790895341.055141:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:7920:x1877889758810880:12345-0@lo:502: Request processed in 3291us (3519us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.055170:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1790895341.055319:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7920:1877889758810880:0@lo:502: 00000020:01000000:2.0:1790895341.055355:0:7920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790895341.055364:0:7920:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1790895341.055372:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895341.055374:0:7920:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1790895341.055379:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1790895341.055382:0:7920:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.154@tcp to nid 0x20000c0a8c99a (192.168.201.154@tcp) 00000020:01000000:2.0:1790895341.055406:0:7920:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1790895341.055409:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790895341.055555:0:7920:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cf203044d40) 00000020:00000080:2.0:1790895341.055578:0:7920:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1790895341.055586:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790895341.058202:0:7920:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1790895341.058214:0:7920:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790895341.058228:0:7920:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf8655 00010000:00080000:3.0:1790895341.058277:0:7920:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf33facf800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:3.0:1790895341.058527:0:7920:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1790895341.058980:0:7920:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790895341.058995:0:7920:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1790895341.061696:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895341.065180:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895341.065282:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1790895341.065334:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1790895341.067470:0:7921:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790895341.067477:0:7921:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790895341.069348:0:7920:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790895341.069364:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790895341.069400:0:7920:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790895341.069423:0:7920:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf865c 00000100:00080000:3.0:1790895341.069434:0:7920:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790895341.069581:0:7920:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf33facf800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:3.0:1790895341.069621:0:7920:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf201180380 x1877889758811008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790895341.069647:0:7920:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790895341.069707:0:7920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895341.069711:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895341.069713:0:7920:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790895341.069716:0:7920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895341.069720:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895341.069721:0:7920:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790895341.069732:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790895341.069734:0:7920:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1790895341.069761:0:7920:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7920:1877889758811136:0@lo:502: 00000100:00100000:3.0:1790895341.069835:0:7920:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.069894:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811136 00000100:00100000:3.0:1790895341.069902:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811136 00000100:00100000:3.0:1790895341.069938:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790895341.069947:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:7920:x1877889758811136:12345-0@lo:502: 00000100:00100000:3.0:1790895341.070193:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:7920:x1877889758811136:12345-0@lo:502: Request processed in 246us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.070201:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1790895341.070257:0:7920:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.070278:0:7920:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201183100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:7920:1877889758811136:0@lo:502: 00000020:01000000:3.0:1790895341.070300:0:7920:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895341.070303:0:7920:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895341.070304:0:7920:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1790895341.070306:0:7920:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1790895341.070349:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1790895341.070361:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790895341.070369:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070378:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895341.070385:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1790895341.070388:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf3031ab380 from 1 10000000:01000000:3.0:1790895341.070389:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1790895341.070410:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070419:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070427:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.070439:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758811264:0@lo:101: 00000100:00100000:3.0:1790895341.070467:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.070481:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.070495:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811264 00000100:00100000:3.0:1790895341.070498:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811264 00000100:00100000:3.0:1790895341.070520:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790895341.070527:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758811264:12345-0@lo:101: 00010000:00010000:3.0:1790895341.070536:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895341.070548:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8663 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070564:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8663 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070572:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8663 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070577:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029cb000, rc 0) 00000100:00100000:3.0:1790895341.070597:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758811264:12345-0@lo:101: Request processed in 72us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895341.070601:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1790895341.070621:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758811264:0@lo:101: 00010000:00010000:3.0:1790895341.070634:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070641:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895341.070677:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758811392:0@lo:501: 00000100:00100000:3.0:1790895341.070700:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895341.070712:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf202217cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.070724:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811392 00000100:00100000:3.0:1790895341.070728:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811392 00000100:00100000:3.0:1790895341.070747:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790895341.070754:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758811392:12345-0@lo:501: 00000100:00100000:3.0:1790895341.070934:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758811392:12345-0@lo:501: Request processed in 181us (234us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790895341.070939:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790895341.070960:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201183100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758811392:0@lo:501: 10000000:01000000:3.0:1790895341.070973:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1790895341.070977:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895341.070982:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895341.071154:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758811776:0@lo:400: 00000100:00100000:0.0:1790895341.071198:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.071223:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895341.071237:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758811904:0@lo:400: 00000100:00100000:0.0:1790895341.071268:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.071290:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811776 00000100:00100000:0.0:1790895341.071294:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811776 00000100:00100000:0.0:1790895341.071313:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895341.071317:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758811776:12345-0@lo:400: 00000100:00100000:0.0:1790895341.071343:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758811776:12345-0@lo:400: Request processed in 26us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895341.071347:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1790895341.071365:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c22d80 x1877889758811776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895341.071372:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758811776:0@lo:400: 00000100:00100000:2.0:1790895341.071462:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758811008:0@lo:8: 00000100:00100000:2.0:1790895341.071495:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895341.071534:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758811648:0@lo:400: 00000100:00100000:2.0:1790895341.071554:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895341.071568:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790895341.071572:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758811520:0@lo:400: 00000100:00100000:2.0:1790895341.071584:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895341.071600:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811904 00000100:00100000:2.0:1790895341.071608:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811904 00000100:00100000:2.0:1790895341.071627:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811648 00000100:00100000:2.0:1790895341.071628:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811648 00000100:00100000:2.0:1790895341.071634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811520 00000100:00100000:2.0:1790895341.071636:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811520 00000100:00100000:2.0:1790895341.071646:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790895341.071652:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758811904:12345-0@lo:400: 00000100:00100000:2.0:1790895341.071689:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758811904:12345-0@lo:400: Request processed in 37us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895341.071695:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790895341.071708:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790895341.071714:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758811648:12345-0@lo:400: 00000100:00100000:2.0:1790895341.071744:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758811648:12345-0@lo:400: Request processed in 30us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895341.071750:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790895341.071761:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790895341.071765:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758811520:12345-0@lo:400: 00000100:00100000:2.0:1790895341.071785:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758811520:12345-0@lo:400: Request processed in 20us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895341.071788:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790895341.071799:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758811008 00000100:00100000:2.0:1790895341.071801:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758811008 00000100:00100000:2.0:1790895341.071812:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790895341.071815:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3307:x1877889758811008:12345-0@lo:8: 00010000:00080000:2.0:1790895341.071831:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 214 last 0 00000020:00000080:2.0:1790895341.071851:0:6690:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf8671 00002000:00100000:2.0:1790895341.071880:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cf20129e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790895341.071888:0:6690:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1790895341.071892:0:6690:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1790895341.071977:0:6690:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790895341.072084:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790895341.072103:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cf20129d800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895341.072131:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1877889758811008:12345-0@lo:8: Request processed in 314us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895341.072135:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1790895341.072180:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c22a00 x1877889758811520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895341.072191:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758811520:0@lo:400: 00010000:00080000:2.0:1790895341.072201:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c21180 x1877889758811648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895341.072209:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758811648:0@lo:400: 00010000:00080000:2.0:1790895341.072234:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201180380 x1877889758811008/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790895351 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895341.072241:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790895341.072247:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1790895341.072255:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790895341.072260:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1790895341.072262:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf33facf800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790895341.072271:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790895341.072276:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758811008:0@lo:8: 00010000:00080000:2.0:1790895341.072298:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c20e00 x1877889758811904/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895341.072313:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758811904:0@lo:400: 00000004:00080000:2.0:1790895341.072335:0:7921:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790895341.072407:0:7921:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 214039548478ns, next at 0ns, rc = 0 00000004:00080000:1.0:1790895341.144311:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1790895341.199248:0:7922:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1790895341.199290:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c23100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812160:0@lo:7: 00000100:00100000:0.0:1790895341.199380:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.199448:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8300 going to sleep for 11 seconds 00000100:00100000:3.0:1790895341.199672:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758812032:0@lo:13: 00000100:00100000:3.0:1790895341.199709:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895341.200340:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812160 00000100:00100000:2.0:1790895341.200350:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812160 00000100:00100000:2.0:1790895341.200414:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790895341.200425:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7922:x1877889758812160:12345-0@lo:7: 00000100:00080000:3.0:1790895341.201722:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895341.201924:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812032 00000100:00100000:1.0:1790895341.201932:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812032 00000100:00100000:1.0:1790895341.203688:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790895341.203704:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758812032:12345-0@lo:13: 00002000:00000024:1.0:1790895341.203735:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1790895341.203820:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758812032:12345-0@lo:13: Request processed in 121us (4110us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895341.203827:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790895341.206046:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c22d80 x1877889758812032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895357 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895341.206076:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758812032:0@lo:13: 00002000:00080000:2.0:1790895341.214284:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1790895341.214293:0:6690:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1790895341.214389:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7922:x1877889758812160:12345-0@lo:7: Request processed in 13961us (15004us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895341.214400:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1790895341.214682:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c23100 x1877889758812160/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1790895357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895341.214698:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c23100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812160:0@lo:7: 00000004:00080000:0.0:1790895341.214712:0:7922:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1790895341.214753:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c23100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812288:0@lo:5: 00000100:00100000:0.0:1790895341.214788:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.214835:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1790895341.215290:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812288 00000100:00100000:2.0:1790895341.215298:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812288 00000100:00100000:2.0:1790895341.215353:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790895341.215363:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7922:x1877889758812288:12345-0@lo:5: 00002000:00080000:2.0:1790895341.215388:0:6691:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1790895341.215391:0:6691:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1790895341.215676:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7922:x1877889758812288:12345-0@lo:5: Request processed in 313us (886us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1790895341.215683:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1790895341.215717:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c23100 x1877889758812288/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790895357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895341.215730:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c23100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812288:0@lo:5: 00000004:00080000:2.0:1790895341.215739:0:7922:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1790895341.215767:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812416:0@lo:700: 00000100:00100000:2.0:1790895341.215807:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895341.215826:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31003f780 going to sleep for 11 seconds 00000100:00100000:2.0:1790895341.215840:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812416 00000100:00100000:2.0:1790895341.215843:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812416 00000100:00100000:2.0:1790895341.215908:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895341.215916:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7922:x1877889758812416:12345-0@lo:700: 00000100:00100000:2.0:1790895341.215960:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1877889758812544:0@lo:700: 00000100:00100000:2.0:1790895341.215988:0:6697:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895341.216012:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31003ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895341.216559:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812544 00000100:00100000:2.0:1790895341.216564:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812544 00000100:00100000:2.0:1790895341.216602:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895341.216609:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1877889758812544:12345-0@lo:700: 00010000:00010000:3.0:1790895341.273661:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:0.0:1790895341.294387:0:5838:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1790895341.301905:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6697:x1877889758812544:12345-0@lo:700: Request processed in 85286us (85907us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895341.301921:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1790895341.305290:0:6697:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf2018ace00 x1877889758812544/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1790895357 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895341.305323:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018ace00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6697:1877889758812544:0@lo:700: 40000000:02000000:0.0:1790895341.305338:0:6697:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:1.0:1790895341.415996:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:1.0:1790895341.416013:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1790895341.416484:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7922:x1877889758812416:12345-0@lo:700: Request processed in 200564us (200671us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895341.416508:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1790895341.416566:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf336be6300 x1877889758812416/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1790895357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895341.416593:0:7922:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1790895341.416610:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812416:0@lo:700: 00000004:02000040:1.0:1790895341.488466:0:7922:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1790895341.498834:0:7922:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812672:0@lo:5: 00000100:00100000:0.0:1790895341.498939:0:7922:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895341.498988:0:7922:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8300 going to sleep for 11 seconds 00000100:00100000:2.0:1790895341.500765:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812672 00000100:00100000:2.0:1790895341.500780:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812672 00000100:00100000:2.0:1790895341.500835:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895341.500843:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7922:x1877889758812672:12345-0@lo:5: 00002000:00080000:2.0:1790895341.506562:0:6690:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1790895341.506586:0:6690:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:2.0:1790895341.513335:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7922:x1877889758812672:12345-0@lo:5: Request processed in 12483us (14387us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790895341.513348:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1790895341.513553:0:7922:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c21500 x1877889758812672/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1790895357 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895341.513572:0:7922:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7922:1877889758812672:0@lo:5: 00000004:00080000:1.0:1790895341.513588:0:7922:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:2.0:1790895342.259209:0:7989:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790895342.298122:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895343.321997:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895344.344026:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895345.370157:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895346.139212:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895346.139240:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758812800:0@lo:13: 00000100:00100000:3.0:1790895346.139303:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895346.140069:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812800 00000100:00100000:3.0:1790895346.140089:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812800 00000100:00100000:3.0:1790895346.140301:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895346.140321:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758812800:12345-0@lo:13: 00002000:00000024:3.0:1790895346.140355:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895346.140398:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758812800:12345-0@lo:13: Request processed in 90us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895346.140414:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1790895346.140459:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201182680 x1877889758812800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895346.140475:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758812800:0@lo:13: 00000100:00100000:3.0:1790895346.143333:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758813056:0@lo:400: 00000100:00100000:3.0:1790895346.143420:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895346.144488:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790895346.144503:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758812928:0@lo:400: 00000100:00100000:3.0:1790895346.144549:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895346.144845:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758813440:0@lo:400: 00000100:00100000:3.0:1790895346.144897:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895346.145068:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813056 00000100:00100000:3.0:1790895346.145086:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813056 00000100:00100000:3.0:1790895346.145216:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790895346.145227:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758813056:12345-0@lo:400: 00000100:00100000:3.0:1790895346.145297:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758813056:12345-0@lo:400: Request processed in 72us (1877us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895346.145304:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1790895346.145401:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758812928 00000100:00100000:3.0:1790895346.145406:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758812928 00000100:00100000:3.0:1790895346.145433:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790895346.145440:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758812928:12345-0@lo:400: 00000100:00100000:3.0:1790895346.146047:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758812928:12345-0@lo:400: Request processed in 607us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895346.146055:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1790895346.146125:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758813312:0@lo:400: 00000100:00100000:3.0:1790895346.146156:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895346.146183:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895346.146190:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758813184:0@lo:400: 00000100:00100000:3.0:1790895346.146212:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895346.146238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813312 00000100:00100000:3.0:1790895346.146242:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813312 00000100:00080000:2.0:1790895346.147379:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790895346.148245:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895346.151772:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813440 00000100:00100000:0.0:1790895346.151786:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813440 00000100:00100000:0.0:1790895346.151876:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790895346.151888:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758813440:12345-0@lo:400: 00000100:00100000:0.0:1790895346.151973:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758813440:12345-0@lo:400: Request processed in 88us (7074us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895346.151979:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790895346.152090:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813184 00000100:00100000:3.0:1790895346.152095:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813184 00000100:00100000:3.0:1790895346.152203:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790895346.152211:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758813312:12345-0@lo:400: 00000100:00100000:3.0:1790895346.152253:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758813312:12345-0@lo:400: Request processed in 44us (6096us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895346.152260:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790895346.152272:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790895346.152279:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758813184:12345-0@lo:400: 00000100:00100000:3.0:1790895346.152306:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758813184:12345-0@lo:400: Request processed in 29us (6093us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895346.157059:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1790895346.157249:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201182300 x1877889758813184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895346.157263:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758813184:0@lo:400: 00010000:00080000:3.0:1790895346.157276:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201181180 x1877889758813312/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895346.157284:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758813312:0@lo:400: 00000100:00080000:1.0:1790895346.158819:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790895346.158827:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790895346.163755:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758812928:0@lo:400: 00010000:00080000:3.0:1790895346.163781:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201181880 x1877889758813440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895346.163794:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758813440:0@lo:400: 00010000:00080000:3.0:1790895346.163808:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201181500 x1877889758813056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895362 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895346.163816:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758813056:0@lo:400: 00010000:00010000:1.0:1790895346.398894:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895346.648604:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758813568:0@lo:13: 00000100:00100000:0.0:1790895346.648678:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895346.648766:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813568 00000100:00100000:0.0:1790895346.648775:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813568 00000100:00100000:0.0:1790895346.648836:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790895346.648845:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758813568:12345-0@lo:13: 00002000:00000024:0.0:1790895346.648907:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895346.648950:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758813568:12345-0@lo:13: Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895346.648957:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1790895346.648995:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c21880 x1877889758813568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895362 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895346.649012:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758813568:0@lo:13: 00000001:00080000:1.0:1790895346.756714:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:3.0:1790895347.419504:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895347.869073:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895347.869247:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740963968 00000100:00100000:3.0:1790895347.869257:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740963968 00000100:00100000:3.0:1790895347.869298:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 112 00000100:00100000:3.0:1790895347.869305:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2360:x1877889740963968:12345-192.168.201.54@tcp:250: 00010000:00080000:3.0:1790895347.869333:0:5824:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from cfab9d81-c206-47b6-8949-7d56204af956@192.168.201.54@tcp t0 exp 0000000000000000 cur 220 last 0 00000020:00000080:3.0:1790895347.869361:0:5824:0:(genops.c:1384:class_connect()) connect: client cfab9d81-c206-47b6-8949-7d56204af956, cookie 0x7911a98710cf8678 00000100:00080000:3.0:1790895347.869513:0:5824:0:(import.c:65:import_set_state_nolock()) ffff8cf202b2d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790895347.869594:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+5:2360:x1877889740963968:12345-192.168.201.54@tcp:250: Request processed in 287us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895347.869612:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 112 00000100:00100000:3.0:1790895347.882920:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895347.888814:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964096 00000100:00100000:2.0:1790895347.888827:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964096 00000100:00100000:2.0:1790895347.888918:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:2.0:1790895347.888928:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+5:5588:x1877889740964096:12345-192.168.201.54@tcp:101: 00010000:00010000:2.0:1790895347.888942:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895347.888959:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2b8d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895347.888985:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895347.888995:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 6 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895347.889004:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301522000, rc 0) 00000100:00100000:2.0:1790895347.889074:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+6:5588:x1877889740964096:12345-192.168.201.54@tcp:101: Request processed in 147us (6165us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895347.889081:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:2.0:1790895347.898787:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895347.898952:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964224 00000100:00100000:3.0:1790895347.898964:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964224 00000100:00100000:3.0:1790895347.899013:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:3.0:1790895347.899040:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+6:5588:x1877889740964224:12345-192.168.201.54@tcp:501: 00000100:00100000:3.0:1790895347.899509:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+6:5588:x1877889740964224:12345-192.168.201.54@tcp:501: Request processed in 472us (730us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790895347.899519:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:2.0:1790895347.904378:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895347.904838:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964352 00000100:00100000:3.0:1790895347.904849:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964352 00000100:00100000:3.0:1790895347.904925:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:3.0:1790895347.904938:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+6:5588:x1877889740964352:12345-192.168.201.54@tcp:101: 00010000:00010000:3.0:1790895347.904955:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895347.904972:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2b94 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895347.905000:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895347.905011:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 7 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895347.905151:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf300031400, rc 0) 00000100:00100000:3.0:1790895347.905215:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+7:5588:x1877889740964352:12345-192.168.201.54@tcp:101: Request processed in 280us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895347.905222:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:2.0:1790895347.907951:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895347.908049:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964480 00000100:00100000:0.0:1790895347.908059:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964480 00000100:00100000:0.0:1790895347.908113:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:0.0:1790895347.908123:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+7:5588:x1877889740964480:12345-192.168.201.54@tcp:501: 00000100:00100000:0.0:1790895347.908386:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+8:5588:x1877889740964480:12345-192.168.201.54@tcp:501: Request processed in 263us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895347.908394:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:0.0:1790895347.910994:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895347.915890:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964608 00000100:00100000:3.0:1790895347.915906:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964608 00000100:00100000:3.0:1790895347.915963:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:3.0:1790895347.915974:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+8:5588:x1877889740964608:12345-192.168.201.54@tcp:503: 00000100:00100000:3.0:1790895347.916566:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+8:5588:x1877889740964608:12345-192.168.201.54@tcp:503: Request processed in 590us (5577us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895347.916575:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:3.0:1790895347.926195:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895347.926436:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964736 00000100:00100000:2.0:1790895347.926446:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964736 00000100:00100000:2.0:1790895347.926496:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:2.0:1790895347.926507:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+8:5607:x1877889740964736:12345-192.168.201.54@tcp:502: 00000100:00100000:2.0:1790895347.927170:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+8:5607:x1877889740964736:12345-192.168.201.54@tcp:502: Request processed in 661us (980us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895347.927189:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:1.0:1790895347.990757:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895347.990800:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964864 00000100:00100000:1.0:1790895347.990809:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964864 00000100:00100000:1.0:1790895347.990885:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00100000:1.0:1790895347.990895:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+8:5607:x1877889740964864:12345-192.168.201.54@tcp:502: 00000100:00100000:1.0:1790895347.991154:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+8:5607:x1877889740964864:12345-192.168.201.54@tcp:502: Request processed in 259us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895347.991163:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00100000:2.0:1790895348.001593:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895348.001696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740964992 00000100:00100000:3.0:1790895348.001708:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740964992 00000100:00100000:3.0:1790895348.001779:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 120 00000100:00100000:3.0:1790895348.001793:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+8:5588:x1877889740964992:12345-192.168.201.54@tcp:101: 00010000:00010000:3.0:1790895348.001811:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895348.001832:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf300030800/0x7911a98710cf868d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2bbe expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895348.001907:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf300030800/0x7911a98710cf868d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bbe expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895348.001920:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf300030800/0x7911a98710cf868d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bbe expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895348.001928:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf300030800, rc 0) 00000100:00100000:3.0:1790895348.001979:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+9:5588:x1877889740964992:12345-192.168.201.54@tcp:101: Request processed in 190us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895348.001985:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 120 00000100:00100000:3.0:1790895348.010470:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895348.010589:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740965120 00000100:00100000:2.0:1790895348.010604:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740965120 00000100:00100000:2.0:1790895348.010672:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 121 00000100:00100000:2.0:1790895348.010684:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+9:5588:x1877889740965120:12345-192.168.201.54@tcp:256: 20000000:01000000:2.0:1790895348.010716:0:5825:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1790895348.010747:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1790895348.010752:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1790895348.010755:0:5825:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1790895348.010758:0:5825:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1790895348.017100:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+9:5588:x1877889740965120:12345-192.168.201.54@tcp:256: Request processed in 6408us (6629us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895348.017115:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 121 00000100:00100000:2.0:1790895348.024317:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895348.024388:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740965248 00000100:00100000:1.0:1790895348.024398:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740965248 00000100:00100000:1.0:1790895348.024448:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 122 00000100:00100000:1.0:1790895348.024458:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+9:5588:x1877889740965248:12345-192.168.201.54@tcp:101: 00010000:00010000:1.0:1790895348.024474:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895348.024491:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2bc5 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895348.024519:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895348.024639:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895348.024649:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167de00, rc 0) 00000100:00100000:1.0:1790895348.024709:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:5588:x1877889740965248:12345-192.168.201.54@tcp:101: Request processed in 252us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895348.024716:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 122 00000100:00100000:2.0:1790895348.029610:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895348.029693:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740965376 00000100:00100000:3.0:1790895348.029717:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740965376 00000100:00100000:3.0:1790895348.029777:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 123 00000100:00100000:3.0:1790895348.029788:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:5588:x1877889740965376:12345-192.168.201.54@tcp:501: 00000100:00100000:3.0:1790895348.030157:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:5588:x1877889740965376:12345-192.168.201.54@tcp:501: Request processed in 369us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895348.030165:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 123 00000100:00100000:2.0:1790895348.043512:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895348.044768:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740965504 00000100:00100000:3.0:1790895348.044783:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740965504 00000100:00100000:3.0:1790895348.044922:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 124 00000100:00100000:3.0:1790895348.044934:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:5588:x1877889740965504:12345-192.168.201.54@tcp:503: 00000100:00100000:3.0:1790895348.045300:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:5588:x1877889740965504:12345-192.168.201.54@tcp:503: Request processed in 367us (1796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895348.045309:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 124 00000100:00100000:2.0:1790895348.055441:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895348.059701:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740965632 00000100:00100000:0.0:1790895348.059716:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740965632 00000100:00100000:1.0:1790895348.059968:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 125 00000100:00100000:1.0:1790895348.059980:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:5611:x1877889740965632:12345-192.168.201.54@tcp:502: 00000100:00100000:1.0:1790895348.060289:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:5611:x1877889740965632:12345-192.168.201.54@tcp:502: Request processed in 310us (4856us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895348.060298:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 125 00000100:00100000:2.0:1790895348.071837:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895348.073336:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740965760 00000100:00100000:0.0:1790895348.073353:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740965760 00000100:00100000:0.0:1790895348.073423:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 126 00000100:00100000:0.0:1790895348.073433:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:5611:x1877889740965760:12345-192.168.201.54@tcp:502: 00000100:00100000:0.0:1790895348.073684:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:5611:x1877889740965760:12345-192.168.201.54@tcp:502: Request processed in 250us (1856us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895348.073693:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 126 00000100:00100000:3.0:1790895348.082625:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895348.082890:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740965888 00000100:00100000:1.0:1790895348.082900:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740965888 00000100:00100000:1.0:1790895348.082943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:1.0:1790895348.082951:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1877889740965888:12345-192.168.201.54@tcp:38: 00010000:00080000:1.0:1790895348.082995:0:5833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp t0 exp 0000000000000000 cur 221 last 0 00000020:00000080:1.0:1790895348.083058:0:5833:0:(genops.c:1384:class_connect()) connect: client 5979f259-4636-4129-bc0f-4cbabdd61a69, cookie 0x7911a98710cf869b 00000004:00100000:1.0:1790895348.083086:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1790895348.083092:0:5833:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:1.0:1790895348.132952:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8cf3371f9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895348.133026:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2360:x1877889740965888:12345-192.168.201.54@tcp:38: Request processed in 50074us (50411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895348.133036:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00010000:00010000:1.0:1790895348.446110:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895349.138526:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895349.138888:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966016 00000100:00100000:3.0:1790895349.138899:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966016 00000100:00100000:3.0:1790895349.138977:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:3.0:1790895349.138989:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:0:x1877889740966016:12345-192.168.201.54@tcp:41: 00000004:00000024:3.0:1790895349.139072:0:7639:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1790895349.139134:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:0:x1877889740966016:12345-192.168.201.54@tcp:41: Request processed in 147us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895349.139141:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:2.0:1790895349.139298:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00080000:1.0:1790895349.139542:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895349.139766:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966144 00000100:00100000:0.0:1790895349.139773:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966144 00000100:00100000:0.0:1790895349.139812:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:0.0:1790895349.139820:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5588:x1877889740966144:12345-192.168.201.54@tcp:41: 00000004:00000024:0.0:1790895349.139838:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790895349.139911:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5588:x1877889740966144:12345-192.168.201.54@tcp:41: Request processed in 90us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895349.139918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:2.0:1790895349.143632:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895349.144206:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966272 00000100:00100000:3.0:1790895349.144218:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966272 00000100:00100000:3.0:1790895349.144297:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:3.0:1790895349.144308:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5588:x1877889740966272:12345-192.168.201.54@tcp:40: 00000100:00100000:3.0:1790895349.144524:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5588:x1877889740966272:12345-192.168.201.54@tcp:40: Request processed in 218us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895349.144532:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:2.0:1790895349.151597:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895349.151649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895349.151739:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966400 00000100:00100000:1.0:1790895349.151750:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966400 00000100:00100000:1.0:1790895349.151792:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966528 00000100:00100000:1.0:1790895349.151796:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966528 00000100:00100000:1.0:1790895349.151810:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:1.0:1790895349.151818:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877889740966400:12345-192.168.201.54@tcp:8: 00010000:00080000:1.0:1790895349.151849:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1790895349.151908:0:6688:0:(genops.c:1384:class_connect()) connect: client 5979f259-4636-4129-bc0f-4cbabdd61a69, cookie 0x7911a98710cf86a2 00002000:00100000:1.0:1790895349.151920:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5979f259-4636-4129-bc0f-4cbabdd61a69/ffff8cf3371fd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790895349.151944:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790895349.152308:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790895349.152342:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf3371fb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895349.152436:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2360:x1877889740966400:12345-192.168.201.54@tcp:8: Request processed in 616us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895349.152442:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:1.0:1790895349.152472:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:1.0:1790895349.152492:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877889740966528:12345-192.168.201.54@tcp:8: 00010000:00080000:1.0:1790895349.152511:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp t0 exp 0000000000000000 cur 222 last 0 00000020:00000080:1.0:1790895349.152529:0:6688:0:(genops.c:1384:class_connect()) connect: client 5979f259-4636-4129-bc0f-4cbabdd61a69, cookie 0x7911a98710cf86a9 00002000:00100000:1.0:1790895349.152535:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5979f259-4636-4129-bc0f-4cbabdd61a69/ffff8cf30643f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790895349.152550:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790895349.152752:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790895349.152767:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf30643d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895349.152791:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2360:x1877889740966528:12345-192.168.201.54@tcp:8: Request processed in 298us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895349.152798:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:1.0:1790895349.157669:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895349.157812:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895349.158037:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966784 00000100:00100000:2.0:1790895349.158046:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966784 00000100:00100000:2.0:1790895349.158098:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 127 00000100:00100000:2.0:1790895349.158108:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740966784:12345-192.168.201.54@tcp:400: 00000100:00100000:2.0:1790895349.158184:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740966784:12345-192.168.201.54@tcp:400: Request processed in 76us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895349.158209:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 127 00000100:00100000:0.0:1790895349.161296:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966656 00000100:00100000:0.0:1790895349.161322:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966656 00000100:00100000:0.0:1790895349.161388:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:0.0:1790895349.161525:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5588:x1877889740966656:12345-192.168.201.54@tcp:33: 00000004:00080000:0.0:1790895349.195497:0:5834:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33898us 00000004:00200000:2.0:1790895349.227771:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790895349.227923:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5588:x1877889740966656:12345-192.168.201.54@tcp:33: Request processed in 66398us (70258us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895349.227938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00010000:00010000:1.0:1790895349.464890:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895349.466606:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895349.466683:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740966912 00000100:00100000:0.0:1790895349.466693:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740966912 00000100:00100000:0.0:1790895349.466755:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1790895349.466765:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5629:x1877889740966912:12345-192.168.201.54@tcp:101: 00010000:00010000:0.0:1790895349.466784:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895349.466851:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c000/0x7911a98710cf86b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2bef expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895349.466943:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf86b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895349.466958:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895349.466971:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895349.467005:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790895349.467009:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895349.467056:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf86b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895349.467082:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c000/0x7911a98710cf86b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bef expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895349.467118:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf86b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bef expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895349.467127:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:0.0:1790895349.467129:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895349.467133:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c800, rc 0) 00000100:00100000:0.0:1790895349.467193:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:5629:x1877889740966912:12345-192.168.201.54@tcp:101: Request processed in 428us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895349.467200:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000001:00100000:3.0:1790895350.374269:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00010000:00010000:3.0:1790895350.488028:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895351.256308:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758814080:0@lo:400: 00000100:00100000:0.0:1790895351.256393:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895351.256461:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790895351.256468:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758813952:0@lo:400: 00000100:00100000:0.0:1790895351.256539:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895351.256571:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758814464:0@lo:400: 00000100:00100000:0.0:1790895351.256597:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895351.256635:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814080 00000100:00100000:0.0:1790895351.256643:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814080 00000100:00100000:0.0:1790895351.256712:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813952 00000100:00100000:0.0:1790895351.256715:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813952 00000100:00100000:0.0:1790895351.256735:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790895351.256743:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758814080:12345-0@lo:400: 00000100:00100000:0.0:1790895351.256804:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758814080:12345-0@lo:400: Request processed in 61us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.256811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790895351.256834:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790895351.256840:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758813952:12345-0@lo:400: 00000100:00100000:0.0:1790895351.256912:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758813952:12345-0@lo:400: Request processed in 70us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.256918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790895351.256955:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758813952:0@lo:400: 00000100:00100000:0.0:1790895351.256966:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758814080:0@lo:400: 00000100:00100000:1.0:1790895351.257402:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758813696:0@lo:13: 00000100:00100000:1.0:1790895351.257438:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895351.257470:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758814208:0@lo:400: 00000100:00100000:1.0:1790895351.257491:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895351.257511:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790895351.257516:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758813824:0@lo:400: 00000100:00100000:1.0:1790895351.257554:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895351.257590:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758814336:0@lo:400: 00000100:00100000:1.0:1790895351.257612:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790895351.257637:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895351.257649:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814464 00000100:00100000:0.0:1790895351.257798:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813696 00000100:00100000:0.0:1790895351.257804:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813696 00000100:00100000:0.0:1790895351.257846:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790895351.257854:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758813696:12345-0@lo:13: 00002000:00000024:0.0:1790895351.257928:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895351.257968:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758813696:12345-0@lo:13: Request processed in 115us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.257974:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790895351.258017:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895351.258026:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814336 00000100:00100000:0.0:1790895351.258031:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814336 00000100:00100000:0.0:1790895351.258059:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790895351.258066:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758814336:12345-0@lo:400: 00000100:00100000:0.0:1790895351.258096:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758814336:12345-0@lo:400: Request processed in 31us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.258102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1790895351.258116:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895351.258145:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758814336:0@lo:400: 00010000:00080000:0.0:1790895351.258157:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201181880 x1877889758813696/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895351.258180:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758813696:0@lo:13: 00000100:00100000:1.0:1790895351.258430:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814464 00000100:00100000:1.0:1790895351.258475:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814208 00000100:00100000:1.0:1790895351.258479:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814208 00000100:00100000:1.0:1790895351.258493:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790895351.258499:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758814464:12345-0@lo:400: 00000100:00100000:1.0:1790895351.258846:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758814464:12345-0@lo:400: Request processed in 161us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895351.259012:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790895351.259033:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790895351.259042:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758814208:12345-0@lo:400: 00000100:00100000:1.0:1790895351.259083:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758814208:12345-0@lo:400: Request processed in 43us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895351.259089:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1790895351.259123:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c21180 x1877889758814208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895351.259135:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758814208:0@lo:400: 00010000:00080000:1.0:1790895351.259166:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c20a80 x1877889758814464/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895367 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895351.259174:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1790895351.259182:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758814464:0@lo:400: 00000100:00100000:2.0:1790895351.259846:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758813824 00000100:00100000:2.0:1790895351.259855:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758813824 00000100:00100000:2.0:1790895351.259946:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1790895351.259956:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758813824:12345-0@lo:400: 00000100:00100000:2.0:1790895351.260036:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758813824:12345-0@lo:400: Request processed in 83us (2481us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895351.260043:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1790895351.260198:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758813824:0@lo:400: 00000100:00080000:0.0:1790895351.260830:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790895351.512892:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895351.700417:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895351.701546:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967040 00000100:00100000:0.0:1790895351.701562:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967040 00000100:00100000:0.0:1790895351.701667:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:0.0:1790895351.701678:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:5681:x1877889740967040:12345-192.168.201.54@tcp:41: 00000004:00000024:0.0:1790895351.701723:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1790895351.701844:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:5681:x1877889740967040:12345-192.168.201.54@tcp:41: Request processed in 167us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.701852:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00080000:2.0:1790895351.703090:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895351.707438:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895351.707886:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967168 00000100:00100000:0.0:1790895351.707898:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967168 00000100:00100000:0.0:1790895351.707988:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:0.0:1790895351.707999:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5979f259-4636-4129-bc0f-4cbabdd61a69+5:5681:x1877889740967168:12345-192.168.201.54@tcp:13: 00002000:00000024:0.0:1790895351.708026:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895351.708095:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5979f259-4636-4129-bc0f-4cbabdd61a69+5:5681:x1877889740967168:12345-192.168.201.54@tcp:13: Request processed in 98us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.708102:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00080000:2.0:1790895351.708181:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895351.711104:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895351.711241:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967296 00000100:00100000:0.0:1790895351.711253:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967296 00000100:00100000:0.0:1790895351.711758:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:0.0:1790895351.711771:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5681:x1877889740967296:12345-192.168.201.54@tcp:13: 00002000:00000024:0.0:1790895351.711811:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895351.711932:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5979f259-4636-4129-bc0f-4cbabdd61a69+6:5681:x1877889740967296:12345-192.168.201.54@tcp:13: Request processed in 163us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.711957:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00080000:2.0:1790895351.713835:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790895351.768168:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895351.768194:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758814592:0@lo:13: 00000100:00100000:2.0:1790895351.768264:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895351.768401:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814592 00000100:00100000:0.0:1790895351.768410:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814592 00000100:00100000:0.0:1790895351.768472:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790895351.768481:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758814592:12345-0@lo:13: 00002000:00000024:0.0:1790895351.768662:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895351.768725:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758814592:12345-0@lo:13: Request processed in 245us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895351.768733:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1790895351.768892:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a2a00 x1877889758814592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895367 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895351.768911:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758814592:0@lo:13: 00010000:00010000:0.0:1790895352.547631:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790895353.342403:0:5854:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00010000:00010000:3.0:1790895353.562027:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790895353.931572:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000001:02000400:3.0:1790895353.965264:0:8297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1790895354.259107:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895354.259214:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895354.259249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895354.259290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895354.259326:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967680 00000100:00100000:3.0:1790895354.259337:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967680 00000100:00100000:3.0:1790895354.259391:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967808 00000100:00100000:3.0:1790895354.259395:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967808 00000100:00100000:3.0:1790895354.259413:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:3.0:1790895354.259439:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740967680:12345-192.168.201.54@tcp:400: 00000100:00100000:3.0:1790895354.259510:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740967680:12345-192.168.201.54@tcp:400: Request processed in 87us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895354.259512:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967552 00000100:00100000:3.0:1790895354.259519:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:2.0:1790895354.259520:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967552 00000100:00100000:3.0:1790895354.259553:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:3.0:1790895354.259562:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740967808:12345-192.168.201.54@tcp:400: 00000100:00100000:2.0:1790895354.259569:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:2.0:1790895354.259592:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740967552:12345-192.168.201.54@tcp:400: 00000100:00100000:3.0:1790895354.259596:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740967808:12345-192.168.201.54@tcp:400: Request processed in 34us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895354.259618:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:2.0:1790895354.259637:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740967552:12345-192.168.201.54@tcp:400: Request processed in 58us (385us total) trans 0 rc 0/0 00000100:00080000:3.0:1790895354.259639:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790895354.259644:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895354.259648:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895354.259657:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:0.0:1790895354.270060:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967424 00000100:00100000:0.0:1790895354.270078:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967424 00000100:00100000:0.0:1790895354.270157:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 129 00000100:00100000:0.0:1790895354.270169:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:2363:x1877889740967424:12345-192.168.201.54@tcp:400: 00000100:00100000:0.0:1790895354.270266:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:2363:x1877889740967424:12345-192.168.201.54@tcp:400: Request processed in 99us (11169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895354.270274:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 129 00010000:00010000:1.0:1790895354.584302:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895355.608099:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895356.376169:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758814976:0@lo:400: 00000100:00100000:0.0:1790895356.376258:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895356.376338:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895356.376346:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758815104:0@lo:400: 00000100:00100000:0.0:1790895356.376373:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895356.376416:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814976 00000100:00100000:0.0:1790895356.376450:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814976 00000100:00100000:0.0:1790895356.376509:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790895356.376520:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758814976:12345-0@lo:400: 00000100:00100000:0.0:1790895356.376575:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758814976:12345-0@lo:400: Request processed in 57us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895356.376582:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790895356.376606:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758815104 00000100:00100000:0.0:1790895356.376610:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758815104 00000100:00100000:0.0:1790895356.376640:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790895356.376646:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758815104:12345-0@lo:400: 00000100:00100000:0.0:1790895356.376693:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758815104:12345-0@lo:400: Request processed in 47us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895356.376699:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1790895356.376715:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895356.376720:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1790895356.376753:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a2680 x1877889758815104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895356.376766:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758815104:0@lo:400: 00000100:00100000:0.0:1790895356.376777:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758814976:0@lo:400: 00000100:00100000:2.0:1790895356.377122:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758814848:0@lo:400: 00000100:00100000:2.0:1790895356.377155:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895356.377183:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758815360:0@lo:400: 00000100:00100000:2.0:1790895356.377201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895356.377225:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790895356.377230:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758814720:0@lo:400: 00000100:00100000:2.0:1790895356.377254:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895356.377276:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758815232:0@lo:400: 00000100:00100000:2.0:1790895356.377309:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895356.377334:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758815360 00000100:00100000:2.0:1790895356.377338:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758815360 00000100:00100000:2.0:1790895356.377367:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790895356.377374:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758815360:12345-0@lo:400: 00000100:00100000:2.0:1790895356.377411:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758815360:12345-0@lo:400: Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895356.377428:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790895356.377445:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814720 00000100:00100000:2.0:1790895356.377448:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814720 00000100:00100000:2.0:1790895356.377468:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790895356.377473:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758814720:12345-0@lo:400: 00000100:00100000:2.0:1790895356.377500:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758814720:12345-0@lo:400: Request processed in 26us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895356.377505:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1790895356.377529:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758814848 00000100:00100000:2.0:1790895356.377542:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758814848 00000100:00100000:2.0:1790895356.377562:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758815232 00000100:00100000:2.0:1790895356.377565:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758815232 00000100:00100000:2.0:1790895356.377580:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790895356.377585:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758814848:12345-0@lo:400: 00000100:00100000:2.0:1790895356.377612:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758814848:12345-0@lo:400: Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895356.377617:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790895356.377626:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790895356.377631:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758815232:12345-0@lo:400: 00000100:00100000:2.0:1790895356.377649:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758815232:12345-0@lo:400: Request processed in 19us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895356.377667:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1790895356.377693:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758814720:0@lo:400: 00000100:00100000:2.0:1790895356.377702:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758815232:0@lo:400: 00000100:00100000:2.0:1790895356.377709:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758814848:0@lo:400: 00010000:00080000:2.0:1790895356.377718:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a1500 x1877889758815360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895356.377727:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758815360:0@lo:400: 00000100:00100000:1.0:1790895356.378101:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758815488:0@lo:13: 00000100:00100000:1.0:1790895356.378139:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895356.378229:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758815488 00000100:00100000:3.0:1790895356.378236:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758815488 00000100:00100000:3.0:1790895356.378277:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790895356.378294:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758815488:12345-0@lo:13: 00002000:00000024:3.0:1790895356.378323:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895356.378362:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758815488:12345-0@lo:13: Request processed in 79us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895356.378368:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1790895356.378546:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf201181c00 x1877889758815488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895356.378563:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758815488:0@lo:13: 00000100:00080000:0.0:1790895356.378771:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790895356.378776:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790895356.635825:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895356.891336:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895356.891363:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758815616:0@lo:13: 00000100:00100000:1.0:1790895356.891442:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895356.891561:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758815616 00000100:00100000:0.0:1790895356.891569:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758815616 00000100:00100000:0.0:1790895356.891625:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790895356.891636:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758815616:12345-0@lo:13: 00002000:00000024:0.0:1790895356.891673:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895356.891730:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758815616:12345-0@lo:13: Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895356.891739:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1790895356.892325:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a3100 x1877889758815616/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895372 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895356.892344:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758815616:0@lo:13: 00000020:00000080:0.0:1790895357.178402:0:8444:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffea33e4700 20000000:00000080:0.0:1790895357.178420:0:8444:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf34061dc00 uarg=0000000000000000 20000000:01000000:0.0:1790895357.178453:0:8444:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1790895357.178456:0:8444:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1790895357.178459:0:8444:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790895357.178463:0:8444:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1790895357.178468:0:8444:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1790895357.178482:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1790895357.178484:0:8444:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1790895357.178662:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1790895357.178666:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790895357.180468:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1790895357.181109:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1790895357.181163:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1790895357.181216:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1790895357.181231:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1790895357.181233:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790895357.186825:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1790895357.187443:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1790895357.187504:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1790895357.187534:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1790895357.187547:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1790895357.187550:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1790895357.188600:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1790895357.189183:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1790895357.189227:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1790895357.189257:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1790895357.189345:0:8444:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1790895357.189348:0:8444:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1790895357.190178:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1790895357.190564:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1790895357.190615:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1790895357.190645:0:8444:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1790895357.190660:0:8444:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1790895357.190678:0:8444:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190695:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190703:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf85de expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190720:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8608 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190727:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8616 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190734:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8624 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190740:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8640 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190747:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8663 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190814:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190823:0:8444:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.190831:0:8444:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191130:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 9 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191156:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 9 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191181:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758815744:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895357.191313:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191322:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 9 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191331:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758815872:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895357.191363:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8663 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191371:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8663 expref: 18 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191380:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816000:0@lo:104: 00000100:00100000:0.0:1790895357.191421:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895357.191462:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8640 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191471:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8640 expref: 18 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191479:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816128:0@lo:104: 00000100:00100000:0.0:1790895357.191499:0:8444:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895357.191558:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8624 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191566:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8624 expref: 18 pid: 5824 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191580:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816256:0@lo:104: 00010000:00010000:0.0:1790895357.191602:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8616 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191610:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8616 expref: 18 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191617:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816384:0@lo:104: 00010000:00010000:0.0:1790895357.191633:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8608 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191640:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8608 expref: 18 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191647:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816512:0@lo:104: 00010000:00010000:0.0:1790895357.191662:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf85de expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191669:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf85de expref: 18 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191676:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816640:0@lo:104: 00010000:00010000:0.0:1790895357.191692:0:8444:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 18 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895357.191699:0:8444:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 18 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895357.191716:0:8444:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816768:0@lo:104: 00000100:00100000:0.0:1790895357.191731:0:8444:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31003f540 going to sleep for 11 seconds 00000100:00100000:2.0:1790895357.192139:0:7629:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790895357.192159:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895357.192214:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895357.192224:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895357.192231:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895357.192238:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895357.192245:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816000 00000100:00100000:2.0:1790895357.192256:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816000 00000100:00100000:2.0:1790895357.192298:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816128 00000100:00100000:2.0:1790895357.192301:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816128 00000100:00100000:2.0:1790895357.192312:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816256 00000100:00100000:2.0:1790895357.192314:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816256 00000100:00100000:2.0:1790895357.192323:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816384 00000100:00100000:2.0:1790895357.192325:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816384 00000100:00100000:2.0:1790895357.192333:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816512 00000100:00100000:2.0:1790895357.192335:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816512 00000100:00100000:2.0:1790895357.192344:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816640 00000100:00100000:2.0:1790895357.192346:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816640 00000100:00100000:2.0:1790895357.192353:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816768 00000100:00100000:2.0:1790895357.192355:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816768 00000100:00100000:2.0:1790895357.192367:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895357.192375:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+9:8444:x1877889758816000:12345-0@lo:104: 00010000:00010000:2.0:1790895357.192388:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.192452:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790895357.192459:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+9:8444:x1877889758816000:12345-0@lo:104: Request processed in 85us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.192466:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895357.192483:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790895357.192489:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336b94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+8:8444:x1877889758816128:12345-0@lo:104: 00010000:00010000:2.0:1790895357.192496:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.192530:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790895357.192537:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336b94450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+8:8444:x1877889758816128:12345-0@lo:104: Request processed in 49us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.192542:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1790895357.192584:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790895357.192591:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+7:8444:x1877889758816256:12345-0@lo:104: 00010000:00010000:2.0:1790895357.192599:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.192630:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790895357.192635:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+7:8444:x1877889758816256:12345-0@lo:104: Request processed in 46us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.192640:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1790895357.192654:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790895357.192660:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+6:8444:x1877889758816384:12345-0@lo:104: 00010000:00010000:2.0:1790895357.192667:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.192692:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1790895357.192697:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+6:8444:x1877889758816384:12345-0@lo:104: Request processed in 38us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.192702:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790895357.192713:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790895357.192718:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+5:8444:x1877889758816512:12345-0@lo:104: 00010000:00010000:2.0:1790895357.192724:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.192750:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1790895357.192895:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+5:8444:x1877889758816512:12345-0@lo:104: Request processed in 37us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.192903:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1790895357.192923:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790895357.192930:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+4:8444:x1877889758816640:12345-0@lo:104: 00010000:00010000:2.0:1790895357.192937:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.192979:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1790895357.192984:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+4:8444:x1877889758816640:12345-0@lo:104: Request processed in 55us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.192989:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790895357.193000:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790895357.193006:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+3:8444:x1877889758816768:12345-0@lo:104: 00010000:00010000:2.0:1790895357.193013:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193035:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1790895357.193039:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+3:8444:x1877889758816768:12345-0@lo:104: Request processed in 34us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.193044:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1790895357.193059:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1790895357.193064:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193072:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cb600 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895357.193076:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193085:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895357.193103:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895357.193109:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895357.193139:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193146:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895357.193163:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193172:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb600/0x7911a98710cf8663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf866a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193184:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1790895357.193188:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193193:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cae00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895357.193196:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193203:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895357.193210:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895357.193215:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895357.193234:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193240:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895357.193245:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193252:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cae00/0x7911a98710cf8640 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8647 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193262:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1790895357.193265:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193384:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c400 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895357.193388:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193396:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895357.193402:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895357.193408:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895357.193422:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193429:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895357.193444:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193461:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf862b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193470:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1790895357.193473:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193479:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cac00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895357.193482:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193490:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895357.193496:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895357.193501:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895357.193528:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193535:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895357.193541:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193547:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8616 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf861d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193555:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790895357.193563:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193569:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029ca000 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895357.193572:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193579:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895357.193586:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895357.193591:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895357.193603:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193609:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895357.193613:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193619:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029ca000/0x7911a98710cf8608 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf860f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193628:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790895357.193630:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193635:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf301522200 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895357.193638:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193654:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895357.193660:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895357.193666:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895357.193676:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193681:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895357.193685:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193692:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf85de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85e5 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193701:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895357.193704:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193709:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895357.193712:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193719:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895357.193725:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895357.193736:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1790895357.193749:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.193755:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1790895357.194009:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758817280:0@lo:103: 00000100:00100000:3.0:1790895357.194050:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895357.194088:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790895357.194094:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758817152:0@lo:103: 00000100:00100000:3.0:1790895357.194113:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895357.194137:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817280 00000100:00100000:3.0:1790895357.194143:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817280 00010000:00010000:3.0:1790895357.194169:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8616 expref: 19 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895357.194191:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817152 00000100:00100000:3.0:1790895357.194194:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817152 00010000:00010000:3.0:1790895357.194204:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8624 expref: 20 pid: 5824 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895357.194227:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790895357.194235:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+20:3309:x1877889758817280:12345-0@lo:103: 00010000:00010000:3.0:1790895357.194245:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895357.194250:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8616 expref: 20 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895357.194259:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8616 expref: 20 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895357.194459:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895357.194494:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+20:3309:x1877889758817280:12345-0@lo:103: Request processed in 260us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895357.194501:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790895357.194516:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790895357.194523:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758817152:12345-0@lo:103: 00010000:00010000:3.0:1790895357.194531:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895357.194535:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8624 expref: 19 pid: 5824 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895357.194544:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8624 expref: 19 pid: 5824 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895357.194554:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895357.194574:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758817152:12345-0@lo:103: Request processed in 52us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895357.194579:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790895357.194614:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758817152:0@lo:103: 00000100:00100000:3.0:1790895357.194630:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758817280:0@lo:103: 00000100:00100000:3.0:1790895357.194668:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816000:0@lo:104: 00000100:00100000:3.0:1790895357.194676:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816128:0@lo:104: 00010000:00010000:3.0:1790895357.194684:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf3029cb200/0x7911a98710cf862b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8624 expref: 18 pid: 5824 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895357.194694:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816256:0@lo:104: 00010000:00010000:3.0:1790895357.194702:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf861d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8616 expref: 17 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895357.194709:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816384:0@lo:104: 00000100:00100000:3.0:1790895357.194717:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816512:0@lo:104: 00000100:00100000:3.0:1790895357.194724:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816640:0@lo:104: 00000100:00100000:3.0:1790895357.194732:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758816768:0@lo:104: 00010000:00010000:1.0:1790895357.194829:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895357.194836:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895357.194846:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758816896:0@lo:103: 00000100:00100000:1.0:1790895357.194907:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895357.194925:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758817408:0@lo:103: 00000100:00100000:1.0:1790895357.194954:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895357.194972:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790895357.194978:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758817024:0@lo:103: 00000100:00100000:1.0:1790895357.195007:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895357.195017:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758817536:0@lo:103: 00000100:00100000:1.0:1790895357.195034:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895357.195053:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758816896 00000100:00100000:1.0:1790895357.195057:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758816896 00010000:00010000:1.0:1790895357.195072:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8663 expref: 17 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895357.195084:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817408 00000100:00100000:1.0:1790895357.195086:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817408 00010000:00010000:1.0:1790895357.195094:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8608 expref: 18 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895357.195101:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817024 00000100:00100000:1.0:1790895357.195103:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817024 00010000:00010000:1.0:1790895357.195110:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8640 expref: 19 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895357.195118:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817536 00000100:00100000:1.0:1790895357.195120:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817536 00010000:00010000:1.0:1790895357.195127:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf85de expref: 20 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895357.195136:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790895357.195141:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+20:3310:x1877889758816896:12345-0@lo:103: 00010000:00010000:1.0:1790895357.195148:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895357.195152:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8663 expref: 20 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195160:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8663 expref: 20 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195176:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf3029cb000/0x7911a98710cf866a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8663 expref: 20 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195186:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895357.195210:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758816896:12345-0@lo:103: Request processed in 68us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895357.195216:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790895357.195234:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790895357.195239:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+18:3310:x1877889758817408:12345-0@lo:103: 00010000:00010000:1.0:1790895357.195247:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895357.195251:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8608 expref: 18 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195260:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8608 expref: 18 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195270:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf860f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8608 expref: 18 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195457:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895357.195479:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+17:3310:x1877889758817408:12345-0@lo:103: Request processed in 240us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895357.195484:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790895357.195495:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790895357.195500:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+16:3310:x1877889758817024:12345-0@lo:103: 00010000:00010000:1.0:1790895357.195507:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895357.195511:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8640 expref: 16 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195527:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8640 expref: 16 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195537:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167da00/0x7911a98710cf8647 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8640 expref: 16 pid: 5825 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195547:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895357.195569:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+15:3310:x1877889758817024:12345-0@lo:103: Request processed in 69us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895357.195575:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790895357.195586:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790895357.195591:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+14:3310:x1877889758817536:12345-0@lo:103: 00010000:00010000:1.0:1790895357.195598:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895357.195602:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf85de expref: 14 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195610:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf85de expref: 14 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195620:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf85e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf85de expref: 14 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.195629:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895357.195646:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+13:3310:x1877889758817536:12345-0@lo:103: Request processed in 55us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895357.195651:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790895357.195678:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758817024:0@lo:103: 00000100:00100000:1.0:1790895357.195684:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758817536:0@lo:103: 00000100:00100000:1.0:1790895357.195699:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758816896:0@lo:103: 00000100:00100000:1.0:1790895357.195704:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758817408:0@lo:103: 00010000:00010000:2.0:1790895357.196170:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.196179:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf85b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85bb expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.196194:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895357.196196:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895357.196198:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895357.196213:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758817664:0@lo:103: 00000100:00100000:2.0:1790895357.196247:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895357.196399:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895357.196477:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817664 00000100:00100000:1.0:1790895357.196483:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817664 00010000:00010000:1.0:1790895357.196503:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 13 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895357.196528:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740967936 00000100:00100000:1.0:1790895357.196531:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740967936 00010000:00010000:1.0:1790895357.196544:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 10 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895357.196556:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790895357.196563:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306506850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+13:3308:x1877889758817664:12345-0@lo:103: 00010000:00010000:1.0:1790895357.196571:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895357.196575:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 13 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.196584:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 13 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.196595:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7d600/0x7911a98710cf85bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf85b4 expref: 13 pid: 5826 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.196604:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895357.196634:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306506850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+12:3308:x1877889758817664:12345-0@lo:103: Request processed in 72us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895357.196640:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1790895357.196678:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:1.0:1790895357.196693:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740967936:12345-192.168.201.54@tcp:103: 00010000:00010000:1.0:1790895357.196702:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895357.196706:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 10 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.196714:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 10 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895357.196725:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895357.196850:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758817664:0@lo:103: 00000100:00100000:1.0:1790895357.196936:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740967936:12345-192.168.201.54@tcp:103: Request processed in 242us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895357.197073:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:3.0:1790895357.197569:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758815744:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895357.197580:0:8444:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301522000/0x7911a98710cf867f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b8d expref: 9 pid: 5826 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895357.197593:0:8444:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8444:1877889758815872:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895357.197627:0:8444:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895357.202057:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895357.202238:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968064 00000100:00100000:2.0:1790895357.202253:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968064 00010000:00010000:2.0:1790895357.202308:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 9 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895357.202352:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:2.0:1790895357.202362:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+9:2361:x1877889740968064:12345-192.168.201.54@tcp:103: 00010000:00010000:2.0:1790895357.202377:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895357.202382:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 9 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202423:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 9 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202442:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf300031400/0x7911a98710cf8686 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2b94 expref: 9 pid: 5824 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202460:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202469:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202486:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202494:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202501:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202509:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202516:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895357.202521:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.202531:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895357.202815:0:8444:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895357.202835:0:8444:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.203872:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.203896:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7de00/0x7911a98710cf86be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8444 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895357.203916:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895357.204231:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+8:2361:x1877889740968064:12345-192.168.201.54@tcp:103: Request processed in 1866us (2383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895357.204242:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00010000:00010000:1.0:1790895357.656280:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895358.602766:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895358.602954:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968192 00000100:00100000:0.0:1790895358.602965:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968192 00000100:00100000:0.0:1790895358.603025:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 131 00000100:00100000:0.0:1790895358.603036:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+8:5602:x1877889740968192:12345-192.168.201.54@tcp:101: 00010000:00010000:0.0:1790895358.603053:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895358.603072:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf86c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2bf6 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.603098:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf86c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bf6 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.603109:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf86c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bf6 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.603117:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c000, rc 0) 00000100:00100000:0.0:1790895358.603174:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+9:5602:x1877889740968192:12345-192.168.201.54@tcp:101: Request processed in 140us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.603181:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 131 00000100:00100000:2.0:1790895358.605534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895358.605724:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968320 00000100:00100000:0.0:1790895358.605734:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968320 00000100:00100000:0.0:1790895358.605786:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 132 00000100:00100000:0.0:1790895358.605796:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+9:5602:x1877889740968320:12345-192.168.201.54@tcp:501: 00000100:00100000:0.0:1790895358.606128:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+9:5602:x1877889740968320:12345-192.168.201.54@tcp:501: Request processed in 333us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.606146:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 132 00000100:00100000:1.0:1790895358.614215:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895358.614721:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968448 00000100:00100000:2.0:1790895358.614732:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968448 00000100:00100000:2.0:1790895358.614789:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 133 00000100:00100000:2.0:1790895358.614799:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+9:5602:x1877889740968448:12345-192.168.201.54@tcp:503: 00000100:00100000:2.0:1790895358.615111:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+9:5602:x1877889740968448:12345-192.168.201.54@tcp:503: Request processed in 312us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.615120:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 133 00000100:00100000:1.0:1790895358.622266:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895358.622624:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968576 00000100:00100000:3.0:1790895358.622635:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968576 00000100:00100000:3.0:1790895358.622695:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 134 00000100:00100000:3.0:1790895358.622708:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+9:6076:x1877889740968576:12345-192.168.201.54@tcp:502: 00000100:00100000:3.0:1790895358.623230:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+9:6076:x1877889740968576:12345-192.168.201.54@tcp:502: Request processed in 524us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.623238:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 134 00000100:00100000:3.0:1790895358.632973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895358.633064:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968704 00000100:00100000:0.0:1790895358.633075:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968704 00000100:00100000:0.0:1790895358.633137:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 135 00000100:00100000:0.0:1790895358.633148:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+9:6076:x1877889740968704:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790895358.633458:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+9:6076:x1877889740968704:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 311us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.633466:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 135 00000100:00100000:1.0:1790895358.639729:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895358.639901:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968832 00000100:00100000:3.0:1790895358.639913:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968832 00000100:00100000:3.0:1790895358.639973:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 136 00000100:00100000:3.0:1790895358.639984:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+9:5602:x1877889740968832:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895358.640002:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895358.640021:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf300030600/0x7911a98710cf86cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2bfd expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.640050:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf300030600/0x7911a98710cf86cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bfd expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.640062:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf300030600/0x7911a98710cf86cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bfd expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.640071:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf300030600, rc 0) 00000100:00100000:3.0:1790895358.640135:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740968832:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 154us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.640156:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 136 00000100:00100000:1.0:1790895358.642985:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895358.643198:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740968960 00000100:00100000:2.0:1790895358.643208:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740968960 00000100:00100000:2.0:1790895358.643263:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 137 00000100:00100000:2.0:1790895358.643272:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740968960:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.643829:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740968960:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 555us (850us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790895358.643838:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 137 00010000:00010000:1.0:1790895358.680823:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790895358.872718:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790895358.872726:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf332953800 from 39 10000000:01000000:3.0:1790895358.872732:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895358.872782:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.872794:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.872804:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895358.872828:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758817792:0@lo:101: 00000100:00100000:3.0:1790895358.872931:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.872997:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318790d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790895358.873131:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817792 00000100:00100000:0.0:1790895358.873140:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817792 00000100:00100000:0.0:1790895358.873195:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1790895358.873204:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+12:5828:x1877889758817792:12345-0@lo:101: 00010000:00010000:0.0:1790895358.873217:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895358.873229:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf86da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf86d3 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.873252:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf86da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf86d3 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.873263:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf86da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf86d3 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.873273:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7dc00, rc 0) 00000100:00100000:0.0:1790895358.873327:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758817792:12345-0@lo:101: Request processed in 123us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.873334:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1790895358.873427:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758817792:0@lo:101: 00010000:00010000:1.0:1790895358.873444:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.873453:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895358.873505:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758817920:0@lo:501: 00000100:00100000:1.0:1790895358.873533:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.873574:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3064999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.873640:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758817920 00000100:00100000:2.0:1790895358.873651:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758817920 00000100:00100000:2.0:1790895358.873682:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1790895358.873689:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758817920:12345-0@lo:501: 00000100:00100000:2.0:1790895358.873974:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758817920:12345-0@lo:501: Request processed in 285us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.873990:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790895358.874119:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758817920:0@lo:501: 00000100:00100000:1.0:1790895358.874143:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818048:0@lo:503: 00000100:00100000:1.0:1790895358.874178:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.874207:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3064999c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.874335:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818048 00000100:00100000:3.0:1790895358.874340:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818048 00000100:00100000:3.0:1790895358.874363:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1790895358.874370:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758818048:12345-0@lo:503: 00000100:00100000:3.0:1790895358.874520:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758818048:12345-0@lo:503: Request processed in 150us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.874528:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790895358.874807:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818048:0@lo:503: 00000100:00100000:2.0:1790895358.875212:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8463:1877889758818176:0@lo:502: 00000100:00100000:2.0:1790895358.875248:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895358.875279:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3033c6300 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.875373:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818176 00000100:00100000:3.0:1790895358.875378:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818176 00000100:00100000:3.0:1790895358.875411:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790895358.875418:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:8463:x1877889758818176:12345-0@lo:502: 00000100:00100000:3.0:1790895358.875592:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+13:8463:x1877889758818176:12345-0@lo:502: Request processed in 174us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.875606:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1790895358.875688:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8463:1877889758818176:0@lo:502: 00000100:00100000:2.0:1790895358.875728:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8463:1877889758818304:0@lo:502: 00000100:00100000:2.0:1790895358.875760:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895358.875788:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3033c6300 going to sleep for 11 seconds 00000100:00100000:1.0:1790895358.875847:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818304 00000100:00100000:1.0:1790895358.875852:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818304 00000100:00100000:1.0:1790895358.875919:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1790895358.875926:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:8463:x1877889758818304:12345-0@lo:502: 00000100:00100000:1.0:1790895358.876080:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:8463:x1877889758818304:12345-0@lo:502: Request processed in 154us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895358.876087:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1790895358.876247:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8463:1877889758818304:0@lo:502: 00000040:00080000:2.0:1790895358.876268:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1790895358.876445:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1790895358.876461:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790895358.876471:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.876482:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895358.876492:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1790895358.876495:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1790895358.876498:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1790895358.876521:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.876530:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.876547:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895358.876559:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818432:0@lo:101: 00000100:00100000:1.0:1790895358.876586:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.876616:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499600 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.876660:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818432 00000100:00100000:2.0:1790895358.876665:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818432 00000100:00100000:2.0:1790895358.876694:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1790895358.876701:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+13:5828:x1877889758818432:12345-0@lo:101: 00010000:00010000:2.0:1790895358.876710:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895358.876721:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301523000/0x7911a98710cf86e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf86e1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.876742:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301523000/0x7911a98710cf86e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf86e1 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.876752:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301523000/0x7911a98710cf86e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf86e1 expref: 14 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.876767:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301523000, rc 0) 00000100:00100000:2.0:1790895358.876807:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758818432:12345-0@lo:101: Request processed in 107us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.876813:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790895358.876926:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818432:0@lo:101: 00010000:00010000:1.0:1790895358.876938:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.876946:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895358.876996:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818560:0@lo:501: 00000100:00100000:1.0:1790895358.877020:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.877040:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499600 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.877158:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818560 00000100:00100000:2.0:1790895358.877163:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818560 00000100:00100000:2.0:1790895358.877191:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790895358.877198:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758818560:12345-0@lo:501: 00000100:00100000:2.0:1790895358.877394:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758818560:12345-0@lo:501: Request processed in 196us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.877401:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790895358.877564:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818560:0@lo:501: 00000100:00100000:1.0:1790895358.877589:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818688:0@lo:503: 00000100:00100000:1.0:1790895358.877624:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.877645:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499600 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.877696:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818688 00000100:00100000:2.0:1790895358.877700:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818688 00000100:00100000:2.0:1790895358.877763:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1790895358.877771:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758818688:12345-0@lo:503: 00000100:00100000:2.0:1790895358.877942:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758818688:12345-0@lo:503: Request processed in 172us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.877948:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790895358.878020:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758818688:0@lo:503: 00000100:00100000:1.0:1790895358.881116:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8464:1877889758818816:0@lo:502: 00000100:00100000:1.0:1790895358.881201:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.881492:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499240 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.881562:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818816 00000100:00100000:3.0:1790895358.881571:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818816 00000100:00100000:3.0:1790895358.881611:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1790895358.881620:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:8464:x1877889758818816:12345-0@lo:502: 00000100:00100000:3.0:1790895358.881847:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:8464:x1877889758818816:12345-0@lo:502: Request processed in 227us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.881881:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1790895358.882054:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8464:1877889758818816:0@lo:502: 00000020:01000000:1.0:1790895358.882088:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895358.882096:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895358.882099:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790895358.882105:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790895358.882128:0:8464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8464:1877889758818944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895358.882161:0:8464:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.882190:0:8464:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499240 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.882238:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758818944 00000100:00100000:3.0:1790895358.882242:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758818944 00000100:00100000:3.0:1790895358.882260:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1790895358.882266:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:8464:x1877889758818944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895358.882390:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:8464:x1877889758818944:12345-0@lo:502:llog_process_th.0 Request processed in 123us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.882397:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790895358.882472:0:8464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8464:1877889758818944:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790895358.882489:0:8464:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895358.882493:0:8464:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895358.882495:0:8464:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790895358.882499:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1790895358.882700:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1790895358.882715:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1790895358.882725:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.882736:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895358.882746:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790895358.882748:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf310bbd000 from 39 10000000:01000000:3.0:1790895358.882751:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895358.882773:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.882787:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.882797:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895358.882811:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.882840:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.882897:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.883155:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819072 00000100:00100000:2.0:1790895358.883162:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819072 00000100:00100000:2.0:1790895358.883198:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1790895358.883206:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+14:5828:x1877889758819072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895358.883216:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895358.883227:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301522c00/0x7911a98710cf86f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf86ef expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.883262:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301522c00/0x7911a98710cf86f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf86ef expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.883273:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301522c00/0x7911a98710cf86f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf86ef expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.883283:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301522c00, rc 0) 00000100:00100000:2.0:1790895358.883327:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758819072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.883334:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1790895358.883427:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895358.883439:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.883448:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895358.883495:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.883521:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.883551:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.883595:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819200 00000100:00100000:2.0:1790895358.883599:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819200 00000100:00100000:2.0:1790895358.883658:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1790895358.883665:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758819200:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.883919:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758819200:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.883925:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790895358.883993:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819200:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.884021:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.884060:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.884339:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895358.884377:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819328 00000100:00100000:0.0:1790895358.884389:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819328 00000100:00100000:0.0:1790895358.884414:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1790895358.884420:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758819328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.884580:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758819328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.884588:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1790895358.884666:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.885138:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8465:1877889758819456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895358.885183:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.885216:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895358.885269:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819456 00000100:00100000:0.0:1790895358.885274:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819456 00000100:00100000:0.0:1790895358.885295:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1790895358.885301:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:8465:x1877889758819456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.885483:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:8465:x1877889758819456:12345-0@lo:502:llog_process_th.0 Request processed in 182us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.885490:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1790895358.885563:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8465:1877889758819456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895358.885604:0:8465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8465:1877889758819584:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895358.885635:0:8465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.885659:0:8465:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895358.885709:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819584 00000100:00100000:0.0:1790895358.885713:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819584 00000100:00100000:0.0:1790895358.885730:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1790895358.885735:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:8465:x1877889758819584:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.885893:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:8465:x1877889758819584:12345-0@lo:502:llog_process_th.0 Request processed in 157us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.885900:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1790895358.886176:0:8465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8465:1877889758819584:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790895358.886200:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1790895358.886349:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1790895358.886367:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1790895358.886376:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.886386:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895358.886407:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1790895358.886410:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1790895358.886412:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1790895358.886436:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.886444:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.886453:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895358.886467:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.886497:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.886530:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aef00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.886579:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819712 00000100:00100000:3.0:1790895358.886584:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819712 00000100:00100000:3.0:1790895358.886604:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790895358.886610:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+15:5828:x1877889758819712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895358.886618:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895358.886629:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf300030a00/0x7911a98710cf8704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf86fd expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.886648:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf300030a00/0x7911a98710cf8704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf86fd expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.886657:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf300030a00/0x7911a98710cf8704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf86fd expref: 16 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.886666:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf300030a00, rc 0) 00000100:00100000:3.0:1790895358.886704:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758819712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.886710:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1790895358.886783:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895358.886796:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.886805:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895358.886848:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.887011:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.887060:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aef00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895358.887121:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819840 00000100:00100000:1.0:1790895358.887126:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819840 00000100:00100000:2.0:1790895358.887224:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1790895358.887233:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758819840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.887452:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758819840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.887459:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1790895358.887519:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.887547:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.887588:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.887708:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aef00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.887743:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758819968 00000100:00100000:3.0:1790895358.887747:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758819968 00000100:00100000:3.0:1790895358.887771:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1790895358.887777:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758819968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.887953:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758819968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.887960:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1790895358.888035:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758819968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.888489:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8466:1877889758820096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.888527:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.888580:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.888613:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820096 00000100:00100000:3.0:1790895358.888617:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820096 00000100:00100000:3.0:1790895358.888678:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1790895358.888685:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:8466:x1877889758820096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895358.888833:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:8466:x1877889758820096:12345-0@lo:502:llog_process_th.0 Request processed in 148us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.888839:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1790895358.888935:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8466:1877889758820096:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790895358.888959:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790895358.888968:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895358.888970:0:8466:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1790895358.888975:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1790895358.888995:0:8466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8466:1877889758820224:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.889025:0:8466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.889168:0:8466:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aed80 going to sleep for 11 seconds 00000100:00100000:1.0:1790895358.889231:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820224 00000100:00100000:1.0:1790895358.889237:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820224 00000100:00100000:1.0:1790895358.889259:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790895358.889266:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:8466:x1877889758820224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895358.889437:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:8466:x1877889758820224:12345-0@lo:502:llog_process_th.0 Request processed in 171us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895358.889444:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1790895358.889532:0:8466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8466:1877889758820224:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1790895358.889552:0:8466:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790895358.889556:0:8466:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895358.889558:0:8466:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1790895358.889563:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1790895358.889749:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1790895358.889776:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1790895358.889786:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.889798:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895358.889806:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1790895358.889809:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf303072000 from 39 10000000:01000000:3.0:1790895358.889812:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895358.889838:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.889846:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.890283:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895358.890298:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.890330:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.890392:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895358.890421:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820352 00000100:00100000:1.0:1790895358.890426:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820352 00000100:00100000:1.0:1790895358.890486:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790895358.890494:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758820352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895358.890504:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895358.890515:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f91c000/0x7911a98710cf8712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf870b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.890549:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f91c000/0x7911a98710cf8712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf870b expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.890560:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f91c000/0x7911a98710cf8712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf870b expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.890568:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c000, rc 0) 00000100:00100000:1.0:1790895358.890613:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758820352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895358.890619:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1790895358.890676:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895358.890689:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.890697:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895358.890753:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.890778:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.890989:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aed80 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.891076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820480 00000100:00100000:3.0:1790895358.891081:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820480 00000100:00100000:2.0:1790895358.891121:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1790895358.891130:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758820480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.891358:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758820480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.891372:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1790895358.891450:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.891477:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.891512:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.891532:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.891570:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820608 00000100:00100000:2.0:1790895358.891574:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820608 00000100:00100000:2.0:1790895358.891590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1790895358.891595:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758820608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.891728:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758820608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.891735:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1790895358.891802:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.892171:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8467:1877889758820736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.892204:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.892237:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.892286:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820736 00000100:00100000:2.0:1790895358.892291:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820736 00000100:00100000:2.0:1790895358.892310:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1790895358.892317:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:8467:x1877889758820736:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895358.892478:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:8467:x1877889758820736:12345-0@lo:502:llog_process_th.0 Request processed in 161us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.892485:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1790895358.892554:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8467:1877889758820736:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.892590:0:8467:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8467:1877889758820864:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.892620:0:8467:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.892640:0:8467:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.892682:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820864 00000100:00100000:2.0:1790895358.892686:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820864 00000100:00100000:2.0:1790895358.892704:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1790895358.892709:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:8467:x1877889758820864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895358.892896:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:8467:x1877889758820864:12345-0@lo:502:llog_process_th.0 Request processed in 185us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895358.892902:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790895358.893169:0:8467:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8467:1877889758820864:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1790895358.893188:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1790895358.893345:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1790895358.893363:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1790895358.893372:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.893389:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895358.893399:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1790895358.893402:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1790895358.893405:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790895358.893429:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.893437:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.893446:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895358.893459:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.893486:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895358.893543:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf30595b780 going to sleep for 11 seconds 00000100:00100000:1.0:1790895358.893581:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758820992 00000100:00100000:1.0:1790895358.893586:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758820992 00000100:00100000:1.0:1790895358.893647:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1790895358.893655:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758820992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895358.893664:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895358.893674:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f91de00/0x7911a98710cf8720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8719 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.893689:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f91de00/0x7911a98710cf8720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8719 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.893695:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f91de00/0x7911a98710cf8720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8719 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895358.893700:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91de00, rc 0) 00000100:00100000:1.0:1790895358.893729:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758820992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895358.893733:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1790895358.893785:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758820992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895358.893794:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.893800:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895358.893828:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.893844:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895358.894026:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758821120 00000100:00100000:2.0:1790895358.894030:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf30595b780 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.894031:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758821120 00000100:00100000:3.0:1790895358.894053:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1790895358.894060:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758821120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895358.894275:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758821120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.894283:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1790895358.894469:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.894496:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.894533:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895358.894554:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf30595b780 going to sleep for 11 seconds 00000100:00100000:0.0:1790895358.894632:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758821248 00000100:00100000:0.0:1790895358.894637:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758821248 00000100:00100000:0.0:1790895358.894670:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1790895358.894677:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758821248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.894835:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758821248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.894847:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1790895358.894958:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895358.897000:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8468:1877889758821376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895358.897073:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.897172:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3064996c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.897203:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758821376 00000100:00100000:3.0:1790895358.897209:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758821376 00000100:00100000:3.0:1790895358.897244:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1790895358.897253:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:8468:x1877889758821376:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895358.897502:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:8468:x1877889758821376:12345-0@lo:502:llog_process_th.0 Request processed in 251us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.897508:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1790895358.897567:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8468:1877889758821376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790895358.897587:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895358.897594:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895358.897596:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1790895358.897600:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1790895358.897614:0:8468:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8468:1877889758821504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895358.897636:0:8468:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895358.897678:0:8468:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3064996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.897701:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758821504 00000100:00100000:2.0:1790895358.897704:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758821504 00000100:00100000:0.0:1790895358.897752:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1790895358.897763:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:8468:x1877889758821504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895358.897961:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:8468:x1877889758821504:12345-0@lo:502:llog_process_th.0 Request processed in 201us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895358.897967:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1790895358.898006:0:8468:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8468:1877889758821504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790895358.898022:0:8468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895358.898025:0:8468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895358.898026:0:8468:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1790895358.898029:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1790895358.898556:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1790895358.898576:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1790895358.898584:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.898601:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895358.898611:0:5828:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1790895358.898614:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf3031ab380 from 1 10000000:01000000:2.0:1790895358.898617:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790895358.898644:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.898653:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895358.898661:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895358.898676:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.898717:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895358.898758:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024e480 going to sleep for 11 seconds 00000100:00100000:3.0:1790895358.898815:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758821632 00000100:00100000:3.0:1790895358.898821:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758821632 00000100:00100000:3.0:1790895358.898892:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1790895358.898901:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758821632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895358.898918:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895358.898932:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf300031800/0x7911a98710cf872e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8727 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.898953:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf300031800/0x7911a98710cf872e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8727 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.898963:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf300031800/0x7911a98710cf872e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8727 expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895358.898971:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf300031800, rc 0) 00000100:00100000:3.0:1790895358.899008:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758821632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895358.899015:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1790895358.899358:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895358.899371:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf872e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.899380:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf872e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895358.899426:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895358.899453:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895358.899512:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aef00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895358.899542:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758821760 00000100:00100000:2.0:1790895358.899547:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758821760 00000100:00100000:2.0:1790895358.899609:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1790895358.899617:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758821760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895358.899838:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758821760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (383us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790895358.899845:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1790895358.899952:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758821760:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1790895358.899975:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1790895358.899981:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf872e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895358.899990:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf872e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895359.370964:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895359.371015:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895359.371054:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895359.371091:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895359.371124:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969472 00000100:00100000:2.0:1790895359.371133:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969472 00000100:00100000:2.0:1790895359.371186:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969344 00000100:00100000:2.0:1790895359.371189:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969344 00000100:00100000:2.0:1790895359.371208:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:2.0:1790895359.371230:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740969472:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895359.371305:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740969472:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 77us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895359.371313:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:2.0:1790895359.371330:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:2.0:1790895359.371347:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740969344:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895359.371373:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740969344:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895359.371397:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:0.0:1790895359.371640:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969216 00000100:00100000:0.0:1790895359.371651:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969216 00000100:00100000:0.0:1790895359.371689:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:0.0:1790895359.371696:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740969216:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895359.371723:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740969216:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 29us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895359.371729:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00080000:0.0:1790895359.371746:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790895359.371751:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895359.371753:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895359.371755:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969088 00000100:00100000:1.0:1790895359.371760:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969088 00000100:00100000:1.0:1790895359.371796:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 170 00000100:00100000:1.0:1790895359.371805:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2361:x1877889740969088:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895359.371882:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2361:x1877889740969088:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 44us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895359.371889:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 170 00010000:00010000:2.0:1790895359.704026:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790895360.271854:0:8505:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc1163a10 20000000:00000080:0.0:1790895360.271932:0:8505:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf336cc5400 uarg=0000000000000000 20000000:01000000:0.0:1790895360.271970:0:8505:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790895360.271975:0:8505:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790895360.271979:0:8505:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790895360.274529:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1790895360.274945:0:8505:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1790895360.282264:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1790895360.282334:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1790895360.282524:0:8505:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1790895360.282546:0:8505:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790895360.282638:0:8505:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.282657:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167d000/0x7911a98710cf84aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.282664:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8505 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.282671:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.282679:0:8505:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.282686:0:8505:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.282725:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 9 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.282751:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 9 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895360.282764:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758821888:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895360.283125:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.283135:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 18 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895360.283156:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758822016:0@lo:104: 00000100:00100000:1.0:1790895360.283197:0:8505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790895360.283273:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8505 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.283284:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8505 expref: 18 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895360.283292:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758822144:0@lo:104: 00000100:00100000:1.0:1790895360.283316:0:8505:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790895360.283884:0:8505:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167d000/0x7911a98710cf84aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.283895:0:8505:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf30167d000/0x7911a98710cf84aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 18 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895360.283904:0:8505:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758822272:0@lo:104: 00000100:00100000:1.0:1790895360.283925:0:8505:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499540 going to sleep for 11 seconds 00000100:00100000:3.0:1790895360.284172:0:7629:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1790895360.284192:0:7629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895360.284219:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822016 00000100:00100000:3.0:1790895360.284226:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822016 00000100:00100000:3.0:1790895360.284266:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822144 00000100:00100000:3.0:1790895360.284269:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822144 00000100:00100000:3.0:1790895360.284278:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822272 00000100:00100000:3.0:1790895360.284280:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822272 00000100:00100000:3.0:1790895360.284292:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790895360.284301:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+5:8505:x1877889758822016:12345-0@lo:104: 00010000:00010000:3.0:1790895360.284325:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895360.284487:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790895360.284496:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201189050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+5:8505:x1877889758822144:12345-0@lo:104: 00010000:00010000:1.0:1790895360.284506:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284564:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790895360.284570:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201189050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+5:8505:x1877889758822144:12345-0@lo:104: Request processed in 76us (1253us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895360.284587:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1790895360.284615:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1790895360.284621:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:8505:x1877889758822272:12345-0@lo:104: 00010000:00010000:1.0:1790895360.284629:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284661:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1790895360.284666:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:8505:x1877889758822272:12345-0@lo:104: Request processed in 46us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895360.284671:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1790895360.284687:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790895360.284693:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284701:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cbc00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:1.0:1790895360.284705:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284712:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790895360.284720:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895360.284725:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790895360.284755:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284761:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790895360.284782:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284800:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbc00/0x7911a98710cf8505 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf850c expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284813:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895360.284817:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284821:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d400 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:1.0:1790895360.284825:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284843:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790895360.284849:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895360.284854:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790895360.284891:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284897:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790895360.284912:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284919:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d400/0x7911a98710cf84a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf84aa expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895360.284928:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895360.284934:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895360.284936:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895360.284943:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895360.284956:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758822400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790895360.284984:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895360.285026:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758822528:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790895360.285209:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758822144:0@lo:104: 00000100:00100000:2.0:1790895360.285218:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758822272:0@lo:104: 00000100:00100000:1.0:1790895360.285271:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895360.285314:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822400 00000100:00100000:1.0:1790895360.285318:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822400 00010000:00010000:1.0:1790895360.285351:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8505 expref: 19 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895360.285465:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822528 00000100:00100000:1.0:1790895360.285469:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822528 00010000:00010000:1.0:1790895360.285484:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167d000/0x7911a98710cf84aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 20 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895360.286047:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790895360.286054:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+3:8505:x1877889758822016:12345-0@lo:104: Request processed in 1754us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895360.286069:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:3.0:1790895360.286114:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895360.286119:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895360.286126:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895360.286129:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895360.286137:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895360.286143:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895360.286148:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790895360.286168:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895360.286174:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895360.286188:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895360.286195:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d800/0x7911a98710cf85d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf85d7 expref: -99 pid: 7623 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895360.286209:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895360.286211:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895360.286212:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895360.286221:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895360.286236:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758822656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895360.286264:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895360.286379:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/1 left), rc = 0 00000100:00100000:2.0:1790895360.287116:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822656 00000100:00100000:2.0:1790895360.287124:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822656 00010000:00010000:2.0:1790895360.287152:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 21 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895360.287172:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790895360.287179:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+21:3309:x1877889758822400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790895360.287192:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895360.287197:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8505 expref: 21 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287206:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8505 expref: 21 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287222:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167c200/0x7911a98710cf850c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8505 expref: 21 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287234:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895360.287516:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895360.287759:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+20:3309:x1877889758822400:12345-0@lo:103:ldlm_bl.0 Request processed in 579us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895360.287767:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790895360.287785:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969600 00000100:00100000:2.0:1790895360.287789:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969600 00010000:00010000:2.0:1790895360.287817:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 10 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895360.287842:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790895360.287849:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758822528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790895360.287879:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895360.287884:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167d000/0x7911a98710cf84aa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 19 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287892:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167d000/0x7911a98710cf84aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 19 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287903:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167d000/0x7911a98710cf84aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf84a3 expref: 19 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287913:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895360.287945:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+18:3310:x1877889758822528:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895360.287951:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790895360.287965:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790895360.287970:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+17:3310:x1877889758822656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790895360.287978:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895360.287982:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 17 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287989:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 17 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.287997:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895360.288024:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+17:3310:x1877889758822656:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895360.288102:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790895360.288118:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:2.0:1790895360.288125:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740969600:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895360.288135:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895360.288140:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 10 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288164:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 10 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288177:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288186:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288202:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288210:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288217:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288223:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288229:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ca00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895360.288239:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288247:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288255:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288266:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895360.288304:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740969600:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 179us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895360.288311:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 24 00010000:00010000:2.0:1790895360.288761:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf8694 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bc5 expref: 9 pid: 5826 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895360.288776:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758821888:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895360.288789:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167c400/0x7911a98710cf85d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf85d0 expref: 16 pid: 5825 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895360.288797:0:8505:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8505:1877889758822016:0@lo:104: 00010000:00010000:2.0:1790895360.288823:0:8505:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288843:0:8505:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288850:0:8505:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.288895:0:8505:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f91ca00/0x7911a98710cf8735 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8505 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895360.290795:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758822400:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895360.290849:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758822656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895360.290873:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758822528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895360.351356:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895360.355713:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969728 00000100:00100000:2.0:1790895360.355728:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969728 00000100:00100000:2.0:1790895360.355781:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 171 00000100:00100000:2.0:1790895360.355791:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+9:5602:x1877889740969728:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895360.355808:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895360.355838:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c04 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.355883:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.355895:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 10 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895360.355904:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301523e00, rc 0) 00000100:00100000:2.0:1790895360.355954:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740969728:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 165us (4609us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895360.355962:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 171 00000100:00100000:3.0:1790895360.361339:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895360.361447:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969856 00000100:00100000:1.0:1790895360.361457:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969856 00000100:00100000:1.0:1790895360.361512:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 172 00000100:00100000:1.0:1790895360.361522:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740969856:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895360.363784:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740969856:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 2254us (2444us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895360.363795:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 172 00000100:00100000:3.0:1790895360.368897:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895360.368974:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740969984 00000100:00100000:1.0:1790895360.368985:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740969984 00000100:00100000:1.0:1790895360.369047:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 173 00000100:00100000:1.0:1790895360.369057:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740969984:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895360.369282:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:5602:x1877889740969984:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 226us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895360.369290:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 173 00000100:00100000:1.0:1790895360.381817:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895360.382275:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740970112 00000100:00100000:2.0:1790895360.382285:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740970112 00000100:00100000:2.0:1790895360.382513:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 174 00000100:00100000:2.0:1790895360.382526:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:6094:x1877889740970112:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790895360.382793:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:6094:x1877889740970112:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 270us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895360.382807:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 174 00000100:00100000:0.0:1790895360.405332:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895360.408151:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740970240 00000100:00100000:3.0:1790895360.408168:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740970240 00000100:00100000:3.0:1790895360.408611:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 175 00000100:00100000:3.0:1790895360.408624:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:6094:x1877889740970240:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790895360.408937:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:6094:x1877889740970240:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 316us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895360.408947:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 175 00010000:00010000:1.0:1790895360.729057:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1790895361.372368:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790895361.372375:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf332953800 from 4 10000000:01000000:2.0:1790895361.372380:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790895361.372531:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.372544:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.372555:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895361.372582:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758822784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.372650:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.372701:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822784 00000100:00100000:2.0:1790895361.372708:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822784 00000100:00100000:2.0:1790895361.372764:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790895361.372773:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758822784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895361.372786:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895361.372797:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8743 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.372829:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8743 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.372840:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8743 expref: 17 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.372885:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301522000, rc 0) 00000100:00100000:2.0:1790895361.372918:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758822784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895361.373042:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1790895361.373094:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861b180 going to sleep for 11 seconds 00000100:00100000:2.0:1790895361.373115:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758822784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895361.373128:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.373135:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895361.373180:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758822912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.373203:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.373216:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895361.373590:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758822912 00000100:00100000:3.0:1790895361.373595:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758822912 00000100:00100000:3.0:1790895361.373632:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1790895361.373640:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758822912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895361.373909:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758822912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895361.373917:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1790895361.373961:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758822912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.373989:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.374026:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.374056:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895361.374240:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823040 00000100:00100000:3.0:1790895361.374244:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823040 00000100:00100000:3.0:1790895361.374283:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1790895361.374290:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758823040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895361.374425:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758823040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895361.374432:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1790895361.374506:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.375017:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8546:1877889758823168:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895361.375053:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.375083:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1790895361.375122:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823168 00000100:00100000:3.0:1790895361.375127:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823168 00000100:00100000:3.0:1790895361.375156:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1790895361.375163:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:8546:x1877889758823168:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895361.375287:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:8546:x1877889758823168:12345-0@lo:502:llog_process_th.0 Request processed in 124us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895361.375294:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1790895361.375426:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8546:1877889758823168:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790895361.375453:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895361.375461:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895361.375464:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790895361.375471:0:8546:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf332953800 00000020:00000080:2.0:1790895361.375474:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790895361.375542:0:8546:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8546:1877889758823296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895361.375576:0:8546:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.375587:0:8546:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3074ba540 going to sleep for 11 seconds 00000100:00100000:0.0:1790895361.378077:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823296 00000100:00100000:0.0:1790895361.378089:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823296 00000100:00100000:0.0:1790895361.378135:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1790895361.378145:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:8546:x1877889758823296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895361.378556:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:8546:x1877889758823296:12345-0@lo:502:llog_process_th.0 Request processed in 411us (2978us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.378564:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1790895361.378581:0:8546:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8546:1877889758823296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790895361.378613:0:8546:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895361.378620:0:8546:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895361.378622:0:8546:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790895361.378627:0:8546:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1790895361.378845:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1790895361.378888:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790895361.378898:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895361.378918:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895361.378945:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790895361.378948:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf310bbd000 from 4 10000000:01000000:0.0:1790895361.378951:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790895361.378980:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895361.378987:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895361.378996:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895361.379014:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790895361.379050:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895361.379072:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823424 00000100:00100000:0.0:1790895361.379076:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823424 00000100:00100000:0.0:1790895361.379097:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790895361.379103:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758823424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895361.379114:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895361.379125:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8751 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895361.379145:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8751 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895361.379155:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8751 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895361.379168:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895361.379191:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758823424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.379198:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1790895361.379232:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895361.379243:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895361.379253:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895361.379261:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895361.379304:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895361.379327:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895361.379354:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823552 00000100:00100000:3.0:1790895361.379358:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823552 00000100:00100000:3.0:1790895361.379384:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1790895361.379391:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758823552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895361.380012:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758823552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 619us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895361.380019:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1790895361.380166:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895361.380180:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895361.380209:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895361.380245:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895361.381019:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1790895361.383269:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823680 00000100:00100000:1.0:1790895361.383281:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823680 00000100:00100000:1.0:1790895361.383364:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1790895361.383373:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758823680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895361.383584:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758823680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (3338us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895361.383592:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1790895361.383667:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758823680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.385326:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8550:1877889758823808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895361.385388:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.385422:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823808 00000100:00100000:2.0:1790895361.385428:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823808 00000100:00100000:2.0:1790895361.385470:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790895361.385477:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:8550:x1877889758823808:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895361.385656:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:8550:x1877889758823808:12345-0@lo:502:llog_process_th.0 Request processed in 178us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895361.385663:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1790895361.385710:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895361.385728:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8550:1877889758823808:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790895361.385755:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895361.385767:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895361.385770:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1790895361.385776:0:8550:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf310bbd000 00000020:00000080:2.0:1790895361.385779:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1790895361.385883:0:8550:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8550:1877889758823936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895361.385912:0:8550:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.385930:0:8550:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1790895361.386234:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758823936 00000100:00100000:0.0:1790895361.386239:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758823936 00000100:00100000:0.0:1790895361.386304:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1790895361.386312:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:8550:x1877889758823936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895361.386435:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:8550:x1877889758823936:12345-0@lo:502:llog_process_th.0 Request processed in 124us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.386447:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1790895361.386509:0:8550:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8550:1877889758823936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790895361.386528:0:8550:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895361.386533:0:8550:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895361.386535:0:8550:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1790895361.386539:0:8550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790895361.386583:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790895361.386610:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895361.386619:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.386631:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895361.386640:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790895361.386642:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf303072000 from 4 10000000:01000000:2.0:1790895361.386645:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790895361.386666:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.386674:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.386682:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895361.386701:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758824064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.386726:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.386746:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824064 00000100:00100000:2.0:1790895361.386750:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824064 00000100:00100000:2.0:1790895361.386775:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790895361.386781:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758824064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895361.386789:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895361.386800:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf875f expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.386831:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf875f expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.386842:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf875f expref: 19 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.386850:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf301522800, rc 0) 00000100:00100000:2.0:1790895361.386893:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758824064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895361.386899:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1790895361.386924:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3074ba540 going to sleep for 11 seconds 00000100:00100000:2.0:1790895361.386935:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758824064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895361.386947:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.386955:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895361.386999:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758824192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.387022:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.387041:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3074ba540 going to sleep for 11 seconds 00000100:00100000:0.0:1790895361.387162:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824192 00000100:00100000:0.0:1790895361.387166:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824192 00000100:00100000:0.0:1790895361.387225:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1790895361.387232:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758824192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895361.387430:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758824192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 198us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.387436:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1790895361.387480:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758824192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.387503:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758824320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.387536:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895361.387553:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824320 00000100:00100000:2.0:1790895361.387557:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824320 00000100:00100000:2.0:1790895361.387572:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790895361.387578:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758824320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895361.387693:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758824320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 114us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895361.387700:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1790895361.387930:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3074ba540 going to sleep for 11 seconds 00000100:00100000:2.0:1790895361.387942:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758824320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895361.389158:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8552:1877889758824448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895361.389211:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895361.389318:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf302b8c600 going to sleep for 11 seconds 00000100:00100000:2.0:1790895361.389344:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824448 00000100:00100000:2.0:1790895361.389349:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824448 00000100:00100000:2.0:1790895361.389375:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1790895361.389381:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:8552:x1877889758824448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895361.389551:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:8552:x1877889758824448:12345-0@lo:502:llog_process_th.0 Request processed in 170us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895361.389558:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1790895361.389604:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8552:1877889758824448:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790895361.389629:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895361.389639:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895361.389642:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790895361.389654:0:8552:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf303072000 00000020:00000080:3.0:1790895361.389657:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790895361.389726:0:8552:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8552:1877889758824576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895361.389756:0:8552:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895361.389766:0:8552:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf302b8c600 going to sleep for 11 seconds 00000100:00100000:1.0:1790895361.390302:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824576 00000100:00100000:1.0:1790895361.390309:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824576 00000100:00100000:1.0:1790895361.390347:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1790895361.390354:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:8552:x1877889758824576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895361.391672:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:8552:x1877889758824576:12345-0@lo:502:llog_process_th.0 Request processed in 1312us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895361.391682:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1790895361.391761:0:8552:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:8552:1877889758824576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790895361.391792:0:8552:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895361.391799:0:8552:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895361.391801:0:8552:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1790895361.391805:0:8552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1790895361.392307:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1790895361.392332:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895361.392342:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895361.392353:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895361.496082:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758824960:0@lo:400:kworker.0 00000100:00100000:3.0:1790895361.496148:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895361.496201:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895361.496208:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758825088:0@lo:400:kworker.0 00000100:00100000:3.0:1790895361.496232:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895361.496269:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824960 00000100:00100000:3.0:1790895361.496276:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824960 00000100:00100000:3.0:1790895361.496344:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790895361.496356:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758824960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895361.496419:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758824960:12345-0@lo:400:kworker.0 Request processed in 66us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895361.496426:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790895361.496448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825088 00000100:00100000:3.0:1790895361.496451:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825088 00000100:00100000:3.0:1790895361.496477:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790895361.496484:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758825088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895361.496514:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758825088:12345-0@lo:400:kworker.0 Request processed in 30us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895361.496528:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1790895361.496545:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790895361.496549:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895361.496584:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758825088:0@lo:400:kworker.0 00010000:00080000:3.0:1790895361.496597:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3397f0000 x1877889758824960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895361.496607:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758824960:0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.496795:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758824832:0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.496834:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895361.496879:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1790895361.496886:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758824704:0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.496906:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895361.496924:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758825216:0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.496944:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895361.496974:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824832 00000100:00100000:0.0:1790895361.496978:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824832 00000100:00100000:0.0:1790895361.497002:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758824704 00000100:00100000:0.0:1790895361.497005:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758824704 00000100:00100000:0.0:1790895361.497018:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790895361.497024:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758824832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.497056:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758824832:12345-0@lo:400:kworker.0 Request processed in 33us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.497062:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790895361.497071:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790895361.497077:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758824704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.497109:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758824704:12345-0@lo:400:kworker.0 Request processed in 32us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.497115:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790895361.497132:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825216 00000100:00100000:0.0:1790895361.497135:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825216 00000100:00100000:0.0:1790895361.497156:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790895361.497162:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758825216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.497188:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758825216:12345-0@lo:400:kworker.0 Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.497194:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790895361.497218:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758824704:0@lo:400:kworker.0 00010000:00080000:0.0:1790895361.497228:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3397f2a00 x1877889758825216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895377 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895361.497236:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758825216:0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.497245:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758824832:0@lo:400:kworker.0 00000100:00100000:0.0:1790895361.497560:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895361.497569:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758825344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895361.497597:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895361.497624:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825344 00000100:00100000:0.0:1790895361.497627:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825344 00000100:00100000:0.0:1790895361.497655:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790895361.497661:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758825344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895361.497689:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895361.497722:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758825344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895361.497738:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1790895361.497767:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a2d80 x1877889758825344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895377 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895361.497782:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758825344:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1790895361.497900:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895361.497904:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790895361.753175:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895362.011386:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790895362.011410:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758825472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790895362.011479:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895362.011542:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825472 00000100:00100000:0.0:1790895362.011550:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825472 00000100:00100000:0.0:1790895362.011591:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790895362.011600:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758825472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895362.011637:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895362.011684:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758825472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895362.011692:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1790895362.011733:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a2d80 x1877889758825472/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895362.011751:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758825472:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1790895362.776105:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895363.800078:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895364.490879:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895364.490915:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895364.490940:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895364.490961:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895364.490995:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740970752 00000100:00100000:1.0:1790895364.491005:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740970752 00000100:00100000:3.0:1790895364.491047:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740970496 00000100:00100000:3.0:1790895364.491054:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740970496 00000100:00100000:1.0:1790895364.491070:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740970624 00000100:00100000:1.0:1790895364.491076:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740970624 00000100:00100000:1.0:1790895364.491107:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:3.0:1790895364.491108:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:3.0:1790895364.491123:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889740970496:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895364.491207:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889740970496:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 88us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895364.491214:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:1.0:1790895364.491231:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889740970752:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895364.491242:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1790895364.491262:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889740970752:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 145us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895364.491265:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1790895364.491273:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:1.0:1790895364.491290:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1790895364.491291:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740970368 00000100:00100000:3.0:1790895364.491296:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740970368 00000100:00100000:1.0:1790895364.491299:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889740970624:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895364.491322:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889740970624:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895364.491329:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1790895364.491334:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 191 00000100:00100000:3.0:1790895364.491356:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:2364:x1877889740970368:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895364.491388:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:2364:x1877889740970368:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 45us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895364.491395:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 191 00000100:00080000:3.0:1790895364.491423:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790895364.491427:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790895364.491429:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790895364.828305:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895365.848968:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790895366.445490:0:8805:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:1.0:1790895366.616529:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758825600:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.616599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895366.616648:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758826112:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.616674:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895366.616699:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790895366.616706:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758825984:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.616740:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895366.616768:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758825728:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.616804:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895366.616823:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758826240:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.616844:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895366.616883:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895366.616889:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758825856:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.616920:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895366.616952:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825600 00000100:00100000:1.0:1790895366.616961:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825600 00000100:00100000:1.0:1790895366.617003:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790895366.617012:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758825600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.617057:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758825600:12345-0@lo:400:kworker.0 Request processed in 46us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895366.617063:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1790895366.617096:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825984 00000100:00100000:1.0:1790895366.617100:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825984 00000100:00100000:1.0:1790895366.617145:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758826240 00000100:00100000:1.0:1790895366.617149:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758826240 00000100:00100000:1.0:1790895366.617182:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790895366.617189:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758825984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.617346:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc03800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758825984:12345-0@lo:400:kworker.0 Request processed in 156us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895366.617353:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790895366.617366:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790895366.617373:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758826240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.617406:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758826240:12345-0@lo:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895366.617412:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790895366.617445:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc03480 x1877889758826240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895366.617459:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758826240:0@lo:400:kworker.0 00010000:00080000:1.0:1790895366.617489:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc01f80 x1877889758825984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895382 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895366.617508:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc01f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758825984:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.617519:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758825600:0@lo:400:kworker.0 00000100:00100000:2.0:1790895366.618263:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758826112 00000100:00100000:2.0:1790895366.618271:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758826112 00000100:00100000:2.0:1790895366.618308:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825728 00000100:00100000:2.0:1790895366.618311:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825728 00000100:00100000:2.0:1790895366.618323:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758825856 00000100:00100000:2.0:1790895366.618325:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758825856 00000100:00100000:2.0:1790895366.618340:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790895366.618347:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758826112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895366.618397:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758826112:12345-0@lo:400:kworker.0 Request processed in 50us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895366.618403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790895366.618416:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790895366.618422:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758825728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895366.618450:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc03b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758825728:12345-0@lo:400:kworker.0 Request processed in 29us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895366.618456:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790895366.618465:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1790895366.618471:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758825856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895366.618492:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758825856:12345-0@lo:400:kworker.0 Request processed in 22us (1572us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895366.618497:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1790895366.620045:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc01880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758825856:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.620063:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc01180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758825728:0@lo:400:kworker.0 00000100:00100000:1.0:1790895366.620102:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc00a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758826112:0@lo:400:kworker.0 00000100:00080000:3.0:1790895366.621005:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790895366.621012:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895366.621015:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895366.621109:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895366.621125:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758826368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895366.621186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895366.621393:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758826368 00000100:00100000:3.0:1790895366.621400:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758826368 00000100:00100000:3.0:1790895366.621452:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790895366.621462:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758826368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895366.621497:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895366.622332:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758826368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 867us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895366.622342:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1790895366.630521:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf2018ad180 x1877889758826368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895382 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895366.630552:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758826368:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790895366.873732:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895367.128166:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790895367.128191:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758826496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790895367.128265:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895367.128784:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758826496 00000100:00100000:0.0:1790895367.128809:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758826496 00000100:00100000:0.0:1790895367.128895:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790895367.128906:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758826496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895367.128945:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895367.129007:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758826496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895367.129015:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1790895367.129268:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a1500 x1877889758826496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895367.129290:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758826496:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895367.897104:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895368.920388:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895369.629414:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895369.629452:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895369.629490:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895369.629512:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895369.629538:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971136 00000100:00100000:3.0:1790895369.629548:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971136 00000100:00100000:3.0:1790895369.629598:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971264 00000100:00100000:3.0:1790895369.629601:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971264 00000100:00100000:3.0:1790895369.629618:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:3.0:1790895369.629630:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740971136:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895369.629728:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740971136:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 101us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895369.629746:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:3.0:1790895369.629762:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:3.0:1790895369.629768:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740971264:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895369.629790:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740971264:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 23us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895369.629796:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:3.0:1790895369.629810:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971008 00000100:00100000:3.0:1790895369.629813:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971008 00000100:00100000:3.0:1790895369.629837:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:3.0:1790895369.629843:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740971008:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895369.629885:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740971008:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 42us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895369.629890:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00080000:3.0:1790895369.629907:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790895369.629921:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895369.629923:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895369.630505:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740970880 00000100:00100000:0.0:1790895369.630511:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740970880 00000100:00100000:0.0:1790895369.630545:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 193 00000100:00100000:0.0:1790895369.630552:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740970880:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895369.630582:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740970880:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 31us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895369.630589:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 193 00010000:00010000:2.0:1790895369.949871:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895370.968007:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895371.743231:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790895371.743258:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758826624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895371.743327:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895371.743393:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758826624 00000100:00100000:0.0:1790895371.743402:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758826624 00000100:00100000:0.0:1790895371.743470:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790895371.743480:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758826624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895371.743513:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895371.743553:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758826624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895371.743559:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1790895371.743577:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790895371.743612:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a3100 x1877889758826624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895387 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895371.743631:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758826624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895371.747923:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758826752:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.748004:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895371.748048:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758827264:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.748073:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895371.748099:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895371.748104:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758826880:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.748128:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895371.748157:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758827008:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.748179:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895371.748195:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895371.748200:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758827136:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.748219:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895371.755782:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758826880 00000100:00100000:2.0:1790895371.755804:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758826880 00000100:00100000:2.0:1790895371.755900:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827008 00000100:00100000:2.0:1790895371.755904:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827008 00000100:00100000:2.0:1790895371.755933:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827136 00000100:00100000:2.0:1790895371.755937:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827136 00000100:00100000:2.0:1790895371.755957:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790895371.755967:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758826880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756058:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758826880:12345-0@lo:400:kworker.0 Request processed in 93us (7928us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895371.756066:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790895371.756085:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790895371.756092:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758827008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756128:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758827008:12345-0@lo:400:kworker.0 Request processed in 36us (7946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895371.756149:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790895371.756164:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790895371.756170:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758827136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756201:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758827136:12345-0@lo:400:kworker.0 Request processed in 32us (7981us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895371.756207:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790895371.756228:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827264 00000100:00100000:2.0:1790895371.756232:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827264 00000100:00100000:2.0:1790895371.756268:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790895371.756275:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758827264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756310:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758827264:12345-0@lo:400:kworker.0 Request processed in 35us (8235us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895371.756316:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790895371.756334:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758826752 00000100:00100000:2.0:1790895371.756338:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758826752 00000100:00100000:2.0:1790895371.756364:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1790895371.756371:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758826752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756400:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758826752:12345-0@lo:400:kworker.0 Request processed in 30us (8396us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895371.756405:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00080000:2.0:1790895371.756432:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895371.756437:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895371.756474:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758826880:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756486:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758826752:0@lo:400:kworker.0 00010000:00080000:2.0:1790895371.756501:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3368bdf80 x1877889758827264/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895371.756521:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758827264:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756565:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758827136:0@lo:400:kworker.0 00000100:00100000:2.0:1790895371.756576:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758827008:0@lo:400:kworker.0 00010000:00010000:3.0:1790895371.992273:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895372.256295:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895372.256320:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758827392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790895372.256408:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895372.256505:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827392 00000100:00100000:0.0:1790895372.256513:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827392 00000100:00100000:0.0:1790895372.256559:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790895372.256567:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758827392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895372.256604:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895372.256663:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758827392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895372.256671:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1790895372.256713:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a3100 x1877889758827392/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895372.256732:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758827392:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1790895372.659800:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing yml_node 00010000:00010000:0.0:1790895373.022998:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895374.053402:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895374.736775:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895374.736821:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895374.736959:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971520 00000100:00100000:2.0:1790895374.736970:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971520 00000100:00100000:2.0:1790895374.737055:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:2.0:1790895374.737067:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740971520:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895374.737150:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740971520:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 86us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895374.737157:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00080000:0.0:1790895374.737821:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895374.737990:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971392 00000100:00100000:3.0:1790895374.737997:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971392 00000100:00100000:3.0:1790895374.738041:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 195 00000100:00100000:3.0:1790895374.738050:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:2363:x1877889740971392:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895374.738108:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:2363:x1877889740971392:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 59us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895374.738115:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 195 00000100:00100000:0.0:1790895374.741949:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895374.741997:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895374.742105:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971648 00000100:00100000:1.0:1790895374.742117:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971648 00000100:00100000:1.0:1790895374.742193:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971776 00000100:00100000:1.0:1790895374.742196:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971776 00000100:00100000:1.0:1790895374.742221:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:1.0:1790895374.742231:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2360:x1877889740971648:12345-192.168.201.54@tcp:9:kworker.0 00000020:00000080:1.0:1790895374.742307:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf86a2 00000100:00080000:1.0:1790895374.742320:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf3371fb000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790895374.742360:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1790895374.742997:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+2:2360:x1877889740971648:12345-192.168.201.54@tcp:9:kworker.0 Request processed in 765us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895374.743006:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:1.0:1790895374.743025:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:1.0:1790895374.743033:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2360:x1877889740971776:12345-192.168.201.54@tcp:9:kworker.0 00000020:00000080:1.0:1790895374.743050:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf86a9 00000100:00080000:1.0:1790895374.743058:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf30643d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1790895374.743080:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1790895374.744905:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790895374.744943:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790895374.744951:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1790895374.745126:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895374.746678:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+2:2360:x1877889740971776:12345-192.168.201.54@tcp:9:kworker.0 Request processed in 3635us (4670us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895374.746692:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00010000:00010000:1.0:1790895375.064904:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790895375.906635:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:0.0:1790895375.906664:0:6715:0:(genops.c:885:class_export_put()) final put ffff8cf3371fd000/5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:2.0:1790895375.906798:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3371fd000/5979f259-4636-4129-bc0f-4cbabdd61a69 for lustre-OST0000 00000020:00000080:2.0:1790895375.906844:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf3371fb000 for lustre-OST0000 00010000:00010000:0.0:1790895376.091944:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895376.856340:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758827776:0@lo:400:kworker.0 00000100:00100000:2.0:1790895376.856415:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895376.856472:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895376.856479:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758827904:0@lo:400:kworker.0 00000100:00100000:2.0:1790895376.856508:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895376.856560:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827904 00000100:00100000:2.0:1790895376.856569:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827904 00000100:00100000:3.0:1790895376.856621:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758827520:0@lo:400:kworker.0 00000100:00100000:2.0:1790895376.856635:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1790895376.856647:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758827904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.856665:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895376.856703:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758828032:0@lo:400:kworker.0 00000100:00100000:2.0:1790895376.856714:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758827904:12345-0@lo:400:kworker.0 Request processed in 69us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895376.856735:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790895376.856737:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790895376.856761:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895376.856767:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790895376.856777:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758827648:0@lo:400:kworker.0 00010000:00080000:2.0:1790895376.856796:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3368bd500 x1877889758827904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895376.856808:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895376.856819:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758827904:0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857106:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758828160:0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857135:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895376.857174:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827776 00000100:00100000:3.0:1790895376.857179:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827776 00000100:00100000:3.0:1790895376.857217:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828032 00000100:00100000:3.0:1790895376.857220:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828032 00000100:00100000:3.0:1790895376.857238:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827648 00000100:00100000:3.0:1790895376.857241:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827648 00000100:00100000:3.0:1790895376.857259:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790895376.857265:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758827776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857311:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758827776:12345-0@lo:400:kworker.0 Request processed in 45us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895376.857318:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1790895376.857332:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790895376.857341:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758828032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857374:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758828032:12345-0@lo:400:kworker.0 Request processed in 36us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895376.857379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790895376.857392:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790895376.857401:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758827648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857437:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758827648:12345-0@lo:400:kworker.0 Request processed in 40us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895376.857443:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790895376.857463:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828160 00000100:00100000:3.0:1790895376.857466:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828160 00000100:00100000:3.0:1790895376.857494:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790895376.857502:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758828160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857533:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758828160:12345-0@lo:400:kworker.0 Request processed in 33us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895376.857539:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790895376.857573:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758827520 00000100:00100000:3.0:1790895376.857578:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758827520 00000100:00100000:3.0:1790895376.857678:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1790895376.857686:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758827520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857720:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758827520:12345-0@lo:400:kworker.0 Request processed in 36us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895376.857726:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:3.0:1790895376.857768:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895376.857772:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895376.857797:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758827776:0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857826:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758827648:0@lo:400:kworker.0 00010000:00080000:3.0:1790895376.857837:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3368bfb80 x1877889758828160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895376.857846:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758828160:0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857879:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758827520:0@lo:400:kworker.0 00000100:00100000:3.0:1790895376.857903:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758828032:0@lo:400:kworker.0 00000100:00100000:2.0:1790895376.860243:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895376.860263:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758828288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895376.860326:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895376.860587:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828288 00000100:00100000:3.0:1790895376.860595:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828288 00000100:00100000:3.0:1790895376.860661:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790895376.860673:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758828288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895376.860704:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895376.860759:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758828288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895376.860766:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1790895376.861158:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3368bd500 x1877889758828288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895392 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895376.861179:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758828288:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790895377.112673:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790895377.316997:0:9243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.63 00000100:00100000:0.0:1790895377.368364:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895377.368387:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758828416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790895377.368475:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895377.368552:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828416 00000100:00100000:0.0:1790895377.368560:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828416 00000100:00100000:0.0:1790895377.368608:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1790895377.368618:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758828416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895377.368655:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895377.368702:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758828416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895377.368708:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1790895377.368750:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33f9a1f80 x1877889758828416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895377.368768:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758828416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790895378.136260:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895379.160529:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790895379.523354:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:0.0:1790895379.523367:0:7641:0:(genops.c:885:class_export_put()) final put ffff8cf30643f000/5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:1.0:1790895379.532900:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30643f000/5979f259-4636-4129-bc0f-4cbabdd61a69 for lustre-OST0001 00000020:00000080:2.0:1790895379.533027:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf30643d000 for lustre-OST0001 00000100:00100000:0.0:1790895379.850340:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895379.850380:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895379.850452:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740971904 00000100:00100000:2.0:1790895379.850463:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740971904 00000100:00100000:2.0:1790895379.850533:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 197 00000100:00100000:2.0:1790895379.850544:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740971904:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895379.850614:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740971904:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 72us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895379.850622:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 197 00000100:00100000:3.0:1790895379.851575:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972032 00000100:00100000:3.0:1790895379.851584:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972032 00000100:00100000:3.0:1790895379.851650:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:3.0:1790895379.851661:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740972032:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895379.851729:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740972032:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 71us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895379.851737:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00080000:2.0:1790895379.855544:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895380.193382:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790895380.375063:0:9342:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.63 00010000:00010000:2.0:1790895381.210346:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895381.978317:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790895381.978342:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758828544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895381.978423:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895381.978613:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828544 00000100:00100000:2.0:1790895381.978622:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828544 00000100:00100000:2.0:1790895381.978703:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1790895381.978713:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758828544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895381.978769:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895381.978818:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758828544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (395us total) trans 0 rc 0/0 00000100:00080000:1.0:1790895381.978997:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790895381.979035:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3368bd500 x1877889758828544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895397 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895381.979057:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758828544:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895381.979206:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790895381.979383:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758828928:0@lo:400:kworker.0 00000100:00100000:0.0:1790895381.979422:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895381.979445:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790895381.979450:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758828800:0@lo:400:kworker.0 00000100:00100000:0.0:1790895381.979500:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895381.983839:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758828672:0@lo:400:kworker.0 00000100:00100000:1.0:1790895381.983991:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895381.984062:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758829184:0@lo:400:kworker.0 00000100:00100000:1.0:1790895381.984090:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895381.984133:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790895381.984140:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758829056:0@lo:400:kworker.0 00000100:00100000:1.0:1790895381.984168:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895381.984326:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828928 00000100:00100000:3.0:1790895381.984336:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828928 00000100:00100000:3.0:1790895381.984395:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828800 00000100:00100000:3.0:1790895381.984398:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828800 00000100:00100000:3.0:1790895381.984415:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829056 00000100:00100000:3.0:1790895381.984417:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829056 00000100:00100000:3.0:1790895381.984434:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790895381.984442:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758828928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895381.984530:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758828928:12345-0@lo:400:kworker.0 Request processed in 88us (5107us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895381.984537:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790895381.984556:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790895381.984562:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758828800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895381.984588:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758828800:12345-0@lo:400:kworker.0 Request processed in 27us (5087us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895381.984593:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790895381.984601:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790895381.984607:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758829056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895381.984629:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758829056:12345-0@lo:400:kworker.0 Request processed in 23us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895381.984634:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790895381.984658:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895381.984703:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758828800:0@lo:400:kworker.0 00000100:00100000:3.0:1790895381.984715:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758828928:0@lo:400:kworker.0 00000100:00100000:1.0:1790895381.985490:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758829056:0@lo:400:kworker.0 00000100:00100000:0.0:1790895381.985767:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829184 00000100:00100000:0.0:1790895381.985774:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829184 00000100:00100000:0.0:1790895381.985832:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790895381.985840:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758829184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895381.985916:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758829184:12345-0@lo:400:kworker.0 Request processed in 77us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895381.985922:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1790895381.985998:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758828672 00000100:00100000:2.0:1790895381.986002:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758828672 00000100:00100000:2.0:1790895381.986034:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1790895381.986041:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758828672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895381.986072:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758828672:12345-0@lo:400:kworker.0 Request processed in 31us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895381.986077:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1790895381.986203:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758828672:0@lo:400:kworker.0 00010000:00080000:1.0:1790895381.986215:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c21500 x1877889758829184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895397 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895381.986226:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758829184:0@lo:400:kworker.0 00000100:00080000:3.0:1790895381.986758:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790895382.233601:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895382.488185:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790895382.488210:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758829312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895382.488281:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895382.488418:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829312 00000100:00100000:0.0:1790895382.488427:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829312 00000100:00100000:0.0:1790895382.488492:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790895382.488503:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758829312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895382.488774:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895382.489658:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758829312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1153us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895382.489669:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1790895382.491034:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c20e00 x1877889758829312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895398 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895382.491059:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758829312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895383.262645:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790895383.271353:0:9439:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.63 00010000:00010000:1.0:1790895384.284624:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790895384.739234:0:9487:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Oct 1 18:56:23 EDT 2026 00000100:00100000:1.0:1790895384.973405:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895384.973462:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895384.973544:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972160 00000100:00100000:2.0:1790895384.973554:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972160 00000100:00100000:2.0:1790895384.973602:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 199 00000100:00100000:2.0:1790895384.973612:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2361:x1877889740972160:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895384.973675:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2361:x1877889740972160:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 65us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895384.973682:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 199 00000100:00100000:3.0:1790895384.973994:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972288 00000100:00100000:3.0:1790895384.973999:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972288 00000100:00100000:3.0:1790895384.975564:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:3.0:1790895384.975577:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740972288:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895384.975652:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740972288:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 78us (2258us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895384.975666:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00080000:2.0:1790895384.979332:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895385.304119:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895386.328919:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895387.097139:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758829568:0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.097208:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895387.097259:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758830080:0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.097284:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895387.097315:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790895387.097321:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758829696:0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.097355:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895387.097397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829568 00000100:00100000:0.0:1790895387.097405:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829568 00000100:00100000:0.0:1790895387.097448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829696 00000100:00100000:0.0:1790895387.097451:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829696 00000100:00100000:0.0:1790895387.097480:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790895387.097488:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758829568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.097557:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758829568:12345-0@lo:400:kworker.0 Request processed in 67us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895387.097564:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790895387.097583:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790895387.097588:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758829696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.097614:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758829696:12345-0@lo:400:kworker.0 Request processed in 26us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895387.097619:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790895387.097639:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830080 00000100:00100000:0.0:1790895387.097642:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830080 00000100:00100000:0.0:1790895387.097669:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790895387.097675:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758830080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.097704:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758830080:12345-0@lo:400:kworker.0 Request processed in 29us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895387.097710:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790895387.097755:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758829696:0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.097766:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758829568:0@lo:400:kworker.0 00010000:00080000:0.0:1790895387.097776:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fe6ed80 x1877889758830080/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895387.097798:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758830080:0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.098170:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758829440:0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.098207:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895387.098248:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758829952:0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.098272:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895387.098292:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895387.098298:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758829824:0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.098322:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790895387.098348:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895387.098353:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895387.098420:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829824 00000100:00100000:2.0:1790895387.098425:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829824 00000100:00100000:2.0:1790895387.098458:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790895387.098465:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758829824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.098503:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758829824:12345-0@lo:400:kworker.0 Request processed in 38us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895387.098509:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1790895387.098527:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790895387.098542:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c20a80 x1877889758829824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895387.098552:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758829824:0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.098569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829952 00000100:00100000:2.0:1790895387.098572:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829952 00000100:00100000:2.0:1790895387.098600:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1790895387.098607:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758829952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.098638:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758829952:12345-0@lo:400:kworker.0 Request processed in 33us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895387.098644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1790895387.098658:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895387.098673:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758829952:0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.100082:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758829440 00000100:00100000:0.0:1790895387.100094:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758829440 00000100:00100000:0.0:1790895387.100153:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1790895387.100163:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758829440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895387.100242:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758829440:12345-0@lo:400:kworker.0 Request processed in 81us (2033us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895387.100248:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1790895387.100527:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758829440:0@lo:400:kworker.0 00000100:00100000:2.0:1790895387.119399:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758830208:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895387.119479:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895387.119559:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830208 00000100:00100000:2.0:1790895387.119571:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830208 00000100:00100000:2.0:1790895387.119627:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790895387.119638:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758830208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895387.119683:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895387.119734:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758830208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895387.119741:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1790895387.120223:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3368be300 x1877889758830208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895387.120248:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758830208:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1790895387.351958:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895387.608234:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758830336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895387.608352:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895387.608952:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830336 00000100:00100000:2.0:1790895387.608963:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830336 00000100:00100000:2.0:1790895387.609019:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790895387.609029:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758830336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790895387.609069:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895387.614364:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758830336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5326us (6002us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895387.614389:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1790895387.618777:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fe6ed80 x1877889758830336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895403 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895387.618812:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758830336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895388.380114:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895389.400056:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895390.089484:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895390.089541:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895390.089621:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972416 00000100:00100000:2.0:1790895390.089633:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972416 00000100:00100000:2.0:1790895390.089697:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 201 00000100:00100000:2.0:1790895390.089720:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740972416:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895390.089794:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740972416:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895390.089801:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 201 00000100:00100000:3.0:1790895390.090270:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972544 00000100:00100000:3.0:1790895390.090278:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972544 00000100:00100000:3.0:1790895390.090355:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:3.0:1790895390.090364:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740972544:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895390.090411:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740972544:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 49us (937us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895390.090417:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00080000:2.0:1790895390.090524:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790895390.425146:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895391.449751:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895392.229666:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895392.229689:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758830464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895392.229751:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895392.229818:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830464 00000100:00100000:0.0:1790895392.229828:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830464 00000100:00100000:0.0:1790895392.229914:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790895392.229924:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758830464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895392.229958:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895392.230000:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758830464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895392.230006:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1790895392.230024:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1790895392.230052:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fe6d500 x1877889758830464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895392.230070:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758830464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895392.230216:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758830720:0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.230250:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895392.230284:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1790895392.230298:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758830592:0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.230328:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895392.230352:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758831104:0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.230390:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895392.230415:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830720 00000100:00100000:1.0:1790895392.230420:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830720 00000100:00100000:1.0:1790895392.230452:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790895392.230459:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758830720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.230496:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc00000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758830720:12345-0@lo:400:kworker.0 Request processed in 38us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895392.230503:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1790895392.230524:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830592 00000100:00100000:1.0:1790895392.230528:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830592 00000100:00100000:1.0:1790895392.230552:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790895392.230558:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758830592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.230586:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758830592:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895392.230591:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1790895392.230629:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758830592:0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.230639:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758830720:0@lo:400:kworker.0 00000100:00100000:2.0:1790895392.230787:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758830976:0@lo:400:kworker.0 00000100:00100000:2.0:1790895392.230817:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895392.230837:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895392.230842:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758830848:0@lo:400:kworker.0 00000100:00100000:2.0:1790895392.230886:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895392.230966:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758831104 00000100:00100000:0.0:1790895392.230976:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758831104 00000100:00100000:0.0:1790895392.231021:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790895392.231028:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758831104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895392.231066:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758831104:12345-0@lo:400:kworker.0 Request processed in 38us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895392.231072:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1790895392.231103:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc02680 x1877889758831104/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895392.231114:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758831104:0@lo:400:kworker.0 00000100:00080000:2.0:1790895392.231160:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895392.231385:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830976 00000100:00100000:1.0:1790895392.231390:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830976 00000100:00100000:1.0:1790895392.231423:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758830848 00000100:00100000:1.0:1790895392.231426:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758830848 00000100:00100000:1.0:1790895392.231445:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790895392.231451:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758830976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.231490:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758830976:12345-0@lo:400:kworker.0 Request processed in 39us (672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895392.231496:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1790895392.231517:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790895392.231523:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758830848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.231552:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758830848:12345-0@lo:400:kworker.0 Request processed in 29us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895392.231557:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790895392.231592:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758830848:0@lo:400:kworker.0 00000100:00100000:1.0:1790895392.231604:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758830976:0@lo:400:kworker.0 00000100:00080000:2.0:1790895392.231665:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790895392.473249:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895392.727990:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895392.728013:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758831232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895392.728082:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895392.728159:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758831232 00000100:00100000:3.0:1790895392.728167:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758831232 00000100:00100000:3.0:1790895392.728222:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790895392.728231:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758831232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895392.728287:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895392.728332:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758831232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895392.728338:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1790895392.728400:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3397f2a00 x1877889758831232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895408 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895392.728419:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758831232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790895393.502790:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895394.524694:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895395.215649:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895395.218969:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895395.219005:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972800 00000100:00100000:0.0:1790895395.219014:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972800 00000100:00100000:0.0:1790895395.219079:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00100000:0.0:1790895395.219090:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740972800:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895395.219170:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740972800:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 81us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895395.219177:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00080000:0.0:1790895395.219198:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895395.226641:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972672 00000100:00100000:2.0:1790895395.226656:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972672 00000100:00100000:2.0:1790895395.226715:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 203 00000100:00100000:2.0:1790895395.226735:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2363:x1877889740972672:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895395.226829:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:2363:x1877889740972672:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 94us (11177us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895395.226838:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 203 00010000:00010000:0.0:1790895395.548003:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895396.569397:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895397.336001:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790895397.336025:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758831360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895397.336106:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895397.336151:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758831360 00000100:00100000:3.0:1790895397.336161:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758831360 00000100:00080000:0.0:1790895397.336197:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895397.336237:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1790895397.336252:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758831360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895397.336289:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895397.336347:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758831360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895397.336354:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1790895397.336494:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fe6d180 x1877889758831360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895397.336535:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758831360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895397.336540:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758831616:0@lo:400:kworker.0 00000100:00100000:0.0:1790895397.336557:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758831488:0@lo:400:kworker.0 00000100:00100000:3.0:1790895397.336580:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895397.336600:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895397.336606:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758831744:0@lo:400:kworker.0 00000100:00100000:3.0:1790895397.336627:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895397.336675:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758831616 00000100:00100000:1.0:1790895397.336680:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758831616 00000100:00100000:1.0:1790895397.336719:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758831744 00000100:00100000:1.0:1790895397.336722:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758831744 00000100:00100000:1.0:1790895397.336749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790895397.336757:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758831616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895397.336797:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758831616:12345-0@lo:400:kworker.0 Request processed in 42us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895397.336804:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790895397.336816:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790895397.336821:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758831744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895397.336846:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758831744:12345-0@lo:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895397.336851:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790895397.336887:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758831872:0@lo:400:kworker.0 00000100:00100000:1.0:1790895397.336910:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895397.336949:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758831744:0@lo:400:kworker.0 00000100:00100000:1.0:1790895397.336967:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758831616:0@lo:400:kworker.0 00000100:00100000:1.0:1790895397.336985:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758831872 00000100:00100000:1.0:1790895397.336988:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758831872 00000100:00100000:1.0:1790895397.337008:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1790895397.337013:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758831872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895397.337274:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758831872:0@lo:400:kworker.0 00000100:00100000:1.0:1790895397.337308:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758831872:12345-0@lo:400:kworker.0 Request processed in 160us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895397.337315:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790895397.337390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895397.337423:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758832000:0@lo:400:kworker.0 00000100:00100000:0.0:1790895397.337448:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790895397.337485:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895397.337531:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832000 00000100:00100000:3.0:1790895397.337535:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832000 00000100:00100000:3.0:1790895397.337587:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1790895397.337595:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758832000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895397.337630:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758832000:12345-0@lo:400:kworker.0 Request processed in 37us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895397.337636:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790895397.337730:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758831488 00000100:00100000:1.0:1790895397.337734:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758831488 00000100:00100000:1.0:1790895397.337767:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1790895397.337774:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758831488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895397.337806:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758831488:12345-0@lo:400:kworker.0 Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895397.337811:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:0.0:1790895397.337916:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790895397.337934:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758831488:0@lo:400:kworker.0 00010000:00080000:0.0:1790895397.337945:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3031f5180 x1877889758832000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895397.337955:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758832000:0@lo:400:kworker.0 00010000:00010000:1.0:1790895397.593394:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895397.851853:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758832128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895397.851941:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895397.852031:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832128 00000100:00100000:2.0:1790895397.852039:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832128 00000100:00100000:2.0:1790895397.852085:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790895397.852102:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758832128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790895397.852138:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895397.852179:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758832128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895397.852185:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1790895397.852237:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3368bd880 x1877889758832128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895413 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895397.852255:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758832128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895398.617095:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895399.640053:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790895400.166195:0:10119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 18:56:39 (1790895399) === 00000100:00100000:0.0:1790895400.329970:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895400.330009:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895400.330222:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740972928 00000100:00100000:2.0:1790895400.330235:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740972928 00000100:00100000:2.0:1790895400.330299:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 205 00000100:00100000:2.0:1790895400.330310:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740972928:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895400.330403:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889740972928:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 95us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895400.330412:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 205 00000100:00100000:3.0:1790895400.330613:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973056 00000100:00100000:3.0:1790895400.330618:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973056 00000100:00100000:3.0:1790895400.330678:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:3.0:1790895400.330689:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740973056:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895400.330730:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740973056:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 45us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.330736:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00080000:0.0:1790895400.330792:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790895400.664056:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895400.675828:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.676065:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973184 00000100:00100000:3.0:1790895400.676077:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973184 00000100:00100000:3.0:1790895400.676154:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 206 00000100:00100000:3.0:1790895400.676166:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+10:8136:x1877889740973184:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790895400.676185:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895400.676206:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf300031200/0x7911a98710cf876d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c0b expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895400.676514:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf300031200/0x7911a98710cf876d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c0b expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895400.676527:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf300031200/0x7911a98710cf876d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c0b expref: 11 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895400.676535:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf300031200, rc 0) 00000100:00100000:3.0:1790895400.676598:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+11:8136:x1877889740973184:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 434us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.676605:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 206 00000100:00100000:2.0:1790895400.684421:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895400.684672:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973312 00000100:00100000:1.0:1790895400.684684:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973312 00000100:00100000:1.0:1790895400.684760:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 207 00000100:00100000:1.0:1790895400.684771:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+11:8136:x1877889740973312:12345-192.168.201.54@tcp:501:mount.lustre.0 00000100:00100000:1.0:1790895400.689425:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+11:8136:x1877889740973312:12345-192.168.201.54@tcp:501:mount.lustre.0 Request processed in 4632us (5004us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895400.689443:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 207 00000100:00100000:0.0:1790895400.694948:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.695037:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973440 00000100:00100000:3.0:1790895400.695049:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973440 00000100:00100000:1.0:1790895400.695225:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 208 00000100:00100000:1.0:1790895400.695238:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+11:8136:x1877889740973440:12345-192.168.201.54@tcp:503:mount.lustre.0 00000100:00100000:1.0:1790895400.695545:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+11:8136:x1877889740973440:12345-192.168.201.54@tcp:503:mount.lustre.0 Request processed in 309us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895400.695554:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 208 00000100:00100000:0.0:1790895400.703096:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895400.703203:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973568 00000100:00100000:1.0:1790895400.703214:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973568 00000100:00100000:1.0:1790895400.703304:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 209 00000100:00100000:1.0:1790895400.703314:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+11:8140:x1877889740973568:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790895400.703588:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+11:8140:x1877889740973568:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 275us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895400.703597:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 209 00000100:00100000:2.0:1790895400.726952:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.727216:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973696 00000100:00100000:3.0:1790895400.727236:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973696 00000100:00100000:3.0:1790895400.727293:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 210 00000100:00100000:3.0:1790895400.727304:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+11:8140:x1877889740973696:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790895400.727889:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+11:8140:x1877889740973696:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 554us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.727897:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 210 00000100:00100000:0.0:1790895400.742769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895400.742992:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973824 00000100:00100000:1.0:1790895400.743004:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973824 00000100:00100000:1.0:1790895400.743063:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 211 00000100:00100000:1.0:1790895400.743074:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+11:8136:x1877889740973824:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:1.0:1790895400.743092:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895400.743109:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f91d600/0x7911a98710cf8774 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c35 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895400.743137:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f91d600/0x7911a98710cf8774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c35 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895400.743159:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f91d600/0x7911a98710cf8774 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c35 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895400.743168:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d600, rc 0) 00000100:00100000:1.0:1790895400.743229:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+12:8136:x1877889740973824:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 157us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895400.743250:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 211 00000100:00100000:0.0:1790895400.745839:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.746072:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740973952 00000100:00100000:3.0:1790895400.746083:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740973952 00000100:00100000:3.0:1790895400.746137:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 212 00000100:00100000:3.0:1790895400.746156:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+12:8136:x1877889740973952:12345-192.168.201.54@tcp:256:mount.lustre.0 20000000:01000000:3.0:1790895400.746182:0:5824:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1790895400.746204:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1790895400.746209:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1790895400.746212:0:5824:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1790895400.746215:0:5824:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1790895400.757612:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+12:8136:x1877889740973952:12345-192.168.201.54@tcp:256:mount.lustre.0 Request processed in 11445us (11769us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.757628:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 212 00000100:00100000:0.0:1790895400.762320:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.762489:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974080 00000100:00100000:3.0:1790895400.762500:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974080 00000100:00100000:3.0:1790895400.763052:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 213 00000100:00100000:3.0:1790895400.763066:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:8136:x1877889740974080:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790895400.763083:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895400.763101:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c3c expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895400.763132:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895400.763172:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895400.763182:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf300031400, rc 0) 00000100:00100000:3.0:1790895400.763245:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:8136:x1877889740974080:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 183us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.763252:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 213 00000100:00100000:0.0:1790895400.766010:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.766115:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974208 00000100:00100000:3.0:1790895400.766126:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974208 00000100:00100000:3.0:1790895400.766224:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 214 00000100:00100000:3.0:1790895400.766234:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:8136:x1877889740974208:12345-192.168.201.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790895400.766679:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:8136:x1877889740974208:12345-192.168.201.54@tcp:501:mount.lustre.0 Request processed in 445us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.766687:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 214 00000100:00100000:2.0:1790895400.769043:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.769138:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974336 00000100:00100000:3.0:1790895400.769158:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974336 00000100:00100000:3.0:1790895400.769251:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 215 00000100:00100000:3.0:1790895400.769262:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:8136:x1877889740974336:12345-192.168.201.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790895400.769495:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:8136:x1877889740974336:12345-192.168.201.54@tcp:503:mount.lustre.0 Request processed in 235us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.769504:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 215 00000100:00100000:0.0:1790895400.772744:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.772997:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974464 00000100:00100000:3.0:1790895400.773009:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974464 00000100:00100000:2.0:1790895400.773405:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 216 00000100:00100000:2.0:1790895400.773418:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:8145:x1877889740974464:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790895400.779486:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:8145:x1877889740974464:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 6058us (6744us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895400.779502:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 216 00000100:00100000:0.0:1790895400.782477:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895400.785992:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974592 00000100:00100000:1.0:1790895400.786009:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974592 00000100:00100000:1.0:1790895400.786078:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 217 00000100:00100000:1.0:1790895400.786088:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:8145:x1877889740974592:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790895400.786355:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:8145:x1877889740974592:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 268us (3888us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895400.786363:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 217 00000100:00100000:2.0:1790895400.792734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895400.792959:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974720 00000100:00100000:1.0:1790895400.792969:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974720 00000100:00100000:1.0:1790895400.793014:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:1.0:1790895400.793023:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1877889740974720:12345-192.168.201.54@tcp:38:mount.lustre.0 00010000:00080000:1.0:1790895400.793056:0:5833:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6eb9aba8-c466-4e48-9c75-9d75f799e495@192.168.201.54@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:1.0:1790895400.793098:0:5833:0:(genops.c:1384:class_connect()) connect: client 6eb9aba8-c466-4e48-9c75-9d75f799e495, cookie 0x7911a98710cf8782 00000004:00100000:1.0:1790895400.793130:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1790895400.793527:0:5833:0:(import.c:65:import_set_state_nolock()) ffff8cf30643b800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895400.793625:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:2360:x1877889740974720:12345-192.168.201.54@tcp:38:mount.lustre.0 Request processed in 602us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895400.793642:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:0.0:1790895400.802449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895400.802489:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.802618:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974976 00000100:00100000:3.0:1790895400.802642:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974976 00000100:00100000:3.0:1790895400.802742:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740974848 00000100:00100000:3.0:1790895400.802746:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740974848 00000100:00100000:3.0:1790895400.802768:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1790895400.802779:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+7:8136:x1877889740974976:12345-192.168.201.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790895400.802823:0:7639:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790895400.802947:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+7:8136:x1877889740974976:12345-192.168.201.54@tcp:41:mount.lustre.0 Request processed in 170us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.802955:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1790895400.802975:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1790895400.802981:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:0:x1877889740974848:12345-192.168.201.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790895400.802992:0:7639:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790895400.803014:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:0:x1877889740974848:12345-192.168.201.54@tcp:41:mount.lustre.0 Request processed in 34us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.803022:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00080000:0.0:1790895400.803666:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895400.804919:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895400.805090:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740975104 00000100:00100000:3.0:1790895400.805100:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740975104 00000100:00100000:3.0:1790895400.805164:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:3.0:1790895400.805175:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:8136:x1877889740975104:12345-192.168.201.54@tcp:40:mount.lustre.0 00000100:00100000:3.0:1790895400.805255:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:8136:x1877889740975104:12345-192.168.201.54@tcp:40:mount.lustre.0 Request processed in 82us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895400.805261:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:3.0:1790895400.808323:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895400.808566:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740975232 00000100:00100000:0.0:1790895400.808577:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740975232 00000100:00100000:0.0:1790895400.808639:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:0.0:1790895400.808647:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1877889740975232:12345-192.168.201.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790895400.808679:0:6691:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6eb9aba8-c466-4e48-9c75-9d75f799e495@192.168.201.54@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:0.0:1790895400.808722:0:6691:0:(genops.c:1384:class_connect()) connect: client 6eb9aba8-c466-4e48-9c75-9d75f799e495, cookie 0x7911a98710cf8789 00002000:00100000:0.0:1790895400.808734:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6eb9aba8-c466-4e48-9c75-9d75f799e495/ffff8cf318f05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790895400.808757:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790895400.809216:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790895400.809248:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf318f07000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895400.809313:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:2360:x1877889740975232:12345-192.168.201.54@tcp:8:mount.lustre.0 Request processed in 665us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895400.809320:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:0.0:1790895400.812456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895400.812543:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895400.812641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740975488 00000100:00100000:2.0:1790895400.812653:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740975488 00000100:00100000:2.0:1790895400.812731:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:2.0:1790895400.812741:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:8136:x1877889740975488:12345-192.168.201.54@tcp:33:mount.lustre.0 00000004:00200000:2.0:1790895400.812822:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790895400.813188:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:8136:x1877889740975488:12345-192.168.201.54@tcp:33:mount.lustre.0 Request processed in 447us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895400.813196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:3.0:1790895400.817529:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740975360 00000100:00100000:3.0:1790895400.817549:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740975360 00000100:00100000:2.0:1790895400.823768:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:2.0:1790895400.823780:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1877889740975360:12345-192.168.201.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790895400.823815:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6eb9aba8-c466-4e48-9c75-9d75f799e495@192.168.201.54@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:2.0:1790895400.823848:0:6690:0:(genops.c:1384:class_connect()) connect: client 6eb9aba8-c466-4e48-9c75-9d75f799e495, cookie 0x7911a98710cf8790 00002000:00100000:2.0:1790895400.823887:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6eb9aba8-c466-4e48-9c75-9d75f799e495/ffff8cf336dc1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790895400.823912:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790895400.824133:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790895400.824177:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cf336dc2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895400.824256:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:2360:x1877889740975360:12345-192.168.201.54@tcp:8:mount.lustre.0 Request processed in 475us (11810us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895400.824263:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000001:00100000:0.0:1790895401.488257:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eb9aba8-c466-4e48-9c75-9d75f799e495 00010000:00010000:0.0:1790895401.693636:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895402.456090:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790895402.456124:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758832256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895402.456188:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895402.456274:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832256 00000100:00100000:0.0:1790895402.456283:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832256 00000100:00100000:0.0:1790895402.456423:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1790895402.456428:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895402.456436:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758832256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895402.456494:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895402.456519:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758832384:0@lo:400:kworker.0 00000100:00100000:0.0:1790895402.456545:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758832256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895402.456553:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790895402.456561:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895402.456597:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758832896:0@lo:400:kworker.0 00000100:00100000:3.0:1790895402.456622:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895402.456645:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895402.456652:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758832512:0@lo:400:kworker.0 00000100:00100000:0.0:1790895402.456664:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832896 00000100:00100000:0.0:1790895402.456669:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832896 00000100:00100000:3.0:1790895402.456679:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895402.456708:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832512 00000100:00100000:3.0:1790895402.456712:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832512 00000100:00100000:0.0:1790895402.456716:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790895402.456726:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758832896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895402.456738:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1790895402.456744:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758832512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895402.456777:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758832896:12345-0@lo:400:kworker.0 Request processed in 52us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895402.456779:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758832512:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895402.456794:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790895402.456794:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1790895402.456822:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790895402.456851:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758832512:0@lo:400:kworker.0 00010000:00080000:0.0:1790895402.456888:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc25c00 x1877889758832896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895418 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895402.456896:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758832768:0@lo:400:kworker.0 00000100:00100000:0.0:1790895402.456902:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758832896:0@lo:400:kworker.0 00000100:00100000:2.0:1790895402.456932:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895402.456948:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790895402.456951:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758832640:0@lo:400:kworker.0 00000100:00100000:2.0:1790895402.456964:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895402.457005:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832768 00000100:00100000:0.0:1790895402.457011:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832768 00000100:00100000:1.0:1790895402.457045:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832384 00000100:00100000:1.0:1790895402.457049:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832384 00000100:00100000:1.0:1790895402.457082:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790895402.457088:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758832384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895402.457100:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758832640 00000100:00100000:0.0:1790895402.457106:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758832640 00000100:00100000:1.0:1790895402.457135:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758832384:12345-0@lo:400:kworker.0 Request processed in 47us (575us total) trans 0 rc 0/0 00000100:00080000:2.0:1790895402.457139:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895402.457140:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1790895402.457166:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790895402.457170:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758832768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895402.457193:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758832768:12345-0@lo:400:kworker.0 Request processed in 22us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895402.457196:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1790895402.457225:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758832768:0@lo:400:kworker.0 00010000:00080000:1.0:1790895402.457249:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fe6dc00 x1877889758832256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895402.457263:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758832256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895402.457292:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790895402.457300:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758832640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895402.457352:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758832640:12345-0@lo:400:kworker.0 Request processed in 53us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895402.457358:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1790895402.457384:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758832384:0@lo:400:kworker.0 00000100:00100000:1.0:1790895402.457437:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758832640:0@lo:400:kworker.0 00010000:00010000:3.0:1790895402.712429:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895402.967983:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895402.968009:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758833024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895402.968075:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895402.968122:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833024 00000100:00100000:3.0:1790895402.968132:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833024 00000100:00100000:3.0:1790895402.968199:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1790895402.968211:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758833024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895402.968257:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895402.968319:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758833024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895402.968326:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1790895402.968635:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3077a8380 x1877889758833024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895418 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895402.968656:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758833024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790895403.745882:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1790895404.579521:0:5854:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6eb9aba8-c466-4e48-9c75-9d75f799e495 00010000:00010000:0.0:1790895404.760150:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1790895405.074036:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eb9aba8-c466-4e48-9c75-9d75f799e495 00010000:00010000:3.0:1790895405.784000:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895405.975177:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895405.975222:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895405.975257:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895405.975280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895405.975306:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895405.975333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740975744 00000100:00100000:0.0:1790895405.975342:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740975744 00000100:00100000:0.0:1790895405.975397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740975872 00000100:00100000:0.0:1790895405.975401:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740975872 00000100:00100000:0.0:1790895405.975428:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:0.0:1790895405.975439:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740975744:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895405.975510:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740975744:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 72us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895405.975602:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740975616 00000100:00100000:2.0:1790895405.975607:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740975616 00000100:00100000:2.0:1790895405.975638:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 219 00000100:00100000:2.0:1790895405.975646:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2362:x1877889740975616:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895405.975674:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2362:x1877889740975616:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895405.975680:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 219 00000100:00100000:0.0:1790895405.975819:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:1.0:1790895405.976143:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:1.0:1790895405.976154:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740975872:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895405.976187:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740975872:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 37us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895405.976194:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:0.0:1790895405.976248:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976128 00000100:00100000:0.0:1790895405.976253:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976128 00000100:00100000:0.0:1790895405.976315:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976000 00000100:00100000:0.0:1790895405.976318:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976000 00000100:00100000:1.0:1790895405.976360:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:1.0:1790895405.976369:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740976128:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895405.976406:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740976128:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 39us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895405.976412:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:1.0:1790895405.976427:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:1.0:1790895405.976433:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740976000:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895405.976458:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740976000:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 25us (1151us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895405.976463:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00080000:0.0:1790895405.976640:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895405.976645:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790895405.976647:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1790895406.307406:0:10318:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:2.0:1790895406.808148:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895407.578287:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758833152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895407.578364:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895407.579704:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833152 00000100:00100000:3.0:1790895407.579717:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833152 00000100:00100000:3.0:1790895407.579782:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1790895407.579794:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758833152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895407.579840:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895407.579916:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758833152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895407.579923:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1790895407.579944:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895407.583543:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758833408:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.583614:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895407.583655:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895407.583661:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758833536:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.583683:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895407.583731:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833408 00000100:00100000:1.0:1790895407.583737:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833408 00000100:00100000:1.0:1790895407.583777:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833536 00000100:00100000:1.0:1790895407.583781:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833536 00000100:00100000:1.0:1790895407.583814:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790895407.583823:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758833408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.583902:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758833408:12345-0@lo:400:kworker.0 Request processed in 80us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895407.583909:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790895407.583934:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1790895407.583940:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758833536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.583969:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758833536:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895407.583975:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1790895407.583999:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895407.584013:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758833664:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584048:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1790895407.584087:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc00380 x1877889758833152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895407.584107:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc00380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758833152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895407.584121:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1790895407.584126:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758833280:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584150:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895407.584169:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758833792:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584189:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895407.584210:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833280 00000100:00100000:1.0:1790895407.584214:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833280 00000100:00100000:1.0:1790895407.584236:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790895407.584242:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758833280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584536:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758833280:12345-0@lo:400:kworker.0 Request processed in 292us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895407.584544:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:1.0:1790895407.584572:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833792 00000100:00100000:1.0:1790895407.584575:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833792 00000100:00100000:1.0:1790895407.584612:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790895407.584627:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758833792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584659:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758833792:12345-0@lo:400:kworker.0 Request processed in 33us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895407.584665:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790895407.584700:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758833536:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584711:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758833408:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584727:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833664 00000100:00100000:1.0:1790895407.584731:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833664 00000100:00100000:1.0:1790895407.584751:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790895407.584756:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758833664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584781:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758833664:12345-0@lo:400:kworker.0 Request processed in 25us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895407.584787:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790895407.584810:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758833280:0@lo:400:kworker.0 00010000:00080000:1.0:1790895407.584819:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf340684380 x1877889758833792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895423 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895407.584827:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758833792:0@lo:400:kworker.0 00000100:00100000:1.0:1790895407.584834:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758833664:0@lo:400:kworker.0 00000100:00080000:3.0:1790895407.585077:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790895407.585082:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790895407.834381:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895408.090455:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758833920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895408.090541:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895408.090620:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758833920 00000100:00100000:3.0:1790895408.090628:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758833920 00000100:00100000:3.0:1790895408.090672:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1790895408.090682:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758833920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895408.090717:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895408.090759:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc26d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758833920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895408.090767:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1790895408.090805:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc24380 x1877889758833920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895408.090822:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758833920:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790895408.857186:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895409.880221:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895410.904511:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895411.082386:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895411.082432:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895411.082472:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895411.082497:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895411.082526:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976256 00000100:00100000:2.0:1790895411.082536:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976256 00000100:00100000:2.0:1790895411.082584:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 221 00000100:00100000:2.0:1790895411.082593:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889740976256:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895411.082659:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889740976256:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895411.082682:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 221 00000100:00100000:2.0:1790895411.082714:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976384 00000100:00100000:2.0:1790895411.082717:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976384 00000100:00100000:2.0:1790895411.082751:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976512 00000100:00100000:2.0:1790895411.082754:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976512 00000100:00100000:2.0:1790895411.082777:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:2.0:1790895411.082784:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740976384:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895411.082813:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740976384:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 30us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895411.082819:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:2.0:1790895411.082831:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:2.0:1790895411.082837:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740976512:12345-192.168.201.54@tcp:400:kworker.0 00000100:00080000:3.0:1790895411.083922:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895411.084447:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740976512:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 20us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895411.084459:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:0.0:1790895411.085660:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976640 00000100:00100000:0.0:1790895411.085672:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976640 00000100:00100000:0.0:1790895411.085760:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:0.0:1790895411.085770:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740976640:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895411.085848:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740976640:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 80us (3415us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895411.085895:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00080000:3.0:1790895411.085950:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895411.089318:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895411.089447:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976768 00000100:00100000:3.0:1790895411.089468:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976768 00000100:00100000:3.0:1790895411.089542:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:3.0:1790895411.089555:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740976768:12345-192.168.201.54@tcp:400:kworker.0 00000100:00080000:2.0:1790895411.089589:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790895411.089643:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740976768:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895411.089652:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 33 00010000:00010000:1.0:1790895411.928117:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895412.697374:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758834048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895412.697450:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895412.697500:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758834560:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.697522:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895412.697547:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790895412.697553:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758834432:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.697591:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895412.697628:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834048 00000100:00100000:0.0:1790895412.697636:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834048 00000100:00100000:0.0:1790895412.697692:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790895412.697702:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758834048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895412.697732:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895412.697773:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758834048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895412.697780:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790895412.697802:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834560 00000100:00100000:0.0:1790895412.697806:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834560 00000100:00100000:0.0:1790895412.697829:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790895412.697835:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758834560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.697901:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758834560:12345-0@lo:400:kworker.0 Request processed in 65us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895412.697908:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790895412.697927:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834432 00000100:00100000:0.0:1790895412.697931:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834432 00000100:00100000:0.0:1790895412.697973:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790895412.697988:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758834432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698019:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758834432:12345-0@lo:400:kworker.0 Request processed in 32us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895412.698025:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1790895412.698041:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790895412.698046:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895412.698082:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758834432:0@lo:400:kworker.0 00010000:00080000:0.0:1790895412.698095:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fe6ed80 x1877889758834048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895412.698110:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758834048:0@lo:13:osp-pre-0-0.0 00010000:00080000:0.0:1790895412.698119:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c22d80 x1877889758834560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895412.698127:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758834560:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698170:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758834176:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698198:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895412.698223:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758834688:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698244:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895412.698262:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1790895412.698267:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758834304:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698284:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895412.698300:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758834816:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698318:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895412.698342:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834176 00000100:00100000:0.0:1790895412.698346:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834176 00000100:00100000:0.0:1790895412.698376:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790895412.698382:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758834176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698414:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758834176:12345-0@lo:400:kworker.0 Request processed in 32us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895412.698420:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1790895412.698444:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834688 00000100:00100000:0.0:1790895412.698448:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834688 00000100:00100000:0.0:1790895412.698471:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834304 00000100:00100000:0.0:1790895412.698474:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834304 00000100:00100000:0.0:1790895412.698491:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790895412.698497:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758834688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698524:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758834688:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895412.698529:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1790895412.698541:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790895412.698546:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758834304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698570:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758834304:12345-0@lo:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895412.698575:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1790895412.698596:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895412.698612:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758834304:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698620:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758834176:0@lo:400:kworker.0 00000100:00100000:0.0:1790895412.698628:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758834688:0@lo:400:kworker.0 00000100:00100000:2.0:1790895412.699567:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834816 00000100:00100000:2.0:1790895412.699574:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834816 00000100:00100000:2.0:1790895412.699617:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790895412.699625:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758834816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895412.699679:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758834816:12345-0@lo:400:kworker.0 Request processed in 55us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895412.699684:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1790895412.699850:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1790895412.699897:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c20a80 x1877889758834816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895412.699923:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758834816:0@lo:400:kworker.0 00010000:00010000:1.0:1790895412.954802:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895413.209297:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895413.209326:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758834944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895413.209392:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895413.209533:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758834944 00000100:00100000:3.0:1790895413.209542:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758834944 00000100:00100000:3.0:1790895413.209681:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790895413.209692:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758834944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895413.209731:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895413.209779:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758834944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895413.209786:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1790895413.209918:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc24380 x1877889758834944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895413.209948:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758834944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790895413.976032:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895415.000280:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895416.024147:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895416.206436:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895416.206519:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895416.206560:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895416.206579:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895416.206616:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977280 00000100:00100000:3.0:1790895416.206625:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977280 00000100:00100000:3.0:1790895416.206683:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:3.0:1790895416.206694:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889740977280:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895416.206777:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889740977280:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895416.206784:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:3.0:1790895416.206810:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740976896 00000100:00100000:3.0:1790895416.206814:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740976896 00000100:00100000:3.0:1790895416.206839:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 223 00000100:00100000:3.0:1790895416.206846:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889740976896:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895416.206911:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889740976896:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 65us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895416.206917:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 223 00000100:00100000:0.0:1790895416.209380:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00080000:0.0:1790895416.209414:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895416.209427:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977408 00000100:00100000:0.0:1790895416.209436:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977408 00000100:00100000:0.0:1790895416.209494:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:0.0:1790895416.209504:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889740977408:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895416.209575:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889740977408:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 72us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895416.209582:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00080000:0.0:1790895416.209603:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895416.210125:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977024 00000100:00100000:1.0:1790895416.210142:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977024 00000100:00100000:1.0:1790895416.210235:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977152 00000100:00100000:1.0:1790895416.210240:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977152 00000100:00100000:3.0:1790895416.210519:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00100000:3.0:1790895416.210531:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889740977024:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895416.210580:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889740977024:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 52us (4151us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895416.210587:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00080000:0.0:1790895416.212099:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895416.212770:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 74 00000100:00100000:1.0:1790895416.212782:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889740977152:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895416.212901:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889740977152:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 122us (6321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895416.212908:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 74 00010000:00010000:2.0:1790895417.057151:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895417.817183:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895417.817212:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758835072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895417.817287:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895417.817355:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835072 00000100:00100000:1.0:1790895417.817363:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835072 00000100:00100000:1.0:1790895417.817417:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1790895417.817426:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758835072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790895417.817459:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895417.817502:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758835072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895417.817509:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1790895417.817528:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1790895417.817555:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33a817800 x1877889758835072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895417.817573:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a817800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758835072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895417.818804:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758835200:0@lo:400:kworker.0 00000100:00100000:3.0:1790895417.818886:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895417.818924:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758835712:0@lo:400:kworker.0 00000100:00100000:3.0:1790895417.818950:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895417.818972:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895417.818978:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758835328:0@lo:400:kworker.0 00000100:00100000:3.0:1790895417.819001:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895417.819025:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835200 00000100:00100000:3.0:1790895417.819030:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835200 00000100:00100000:2.0:1790895417.819169:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758835584:0@lo:400:kworker.0 00000100:00100000:2.0:1790895417.819199:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895417.819217:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895417.819223:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758835456:0@lo:400:kworker.0 00000100:00100000:2.0:1790895417.819242:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895417.819272:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835328 00000100:00100000:2.0:1790895417.819276:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835328 00000100:00100000:2.0:1790895417.819308:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835584 00000100:00100000:2.0:1790895417.819311:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835584 00000100:00100000:2.0:1790895417.819333:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835456 00000100:00100000:2.0:1790895417.819335:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835456 00000100:00100000:2.0:1790895417.819352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790895417.819360:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758835328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895417.819413:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758835328:12345-0@lo:400:kworker.0 Request processed in 53us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895417.819419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1790895417.819435:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790895417.819441:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758835584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895417.819469:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758835584:12345-0@lo:400:kworker.0 Request processed in 28us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895417.819484:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1790895417.819495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790895417.819501:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758835456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895417.819529:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758835456:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895417.819534:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1790895417.819570:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758835456:0@lo:400:kworker.0 00000100:00100000:2.0:1790895417.819580:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758835584:0@lo:400:kworker.0 00000100:00080000:1.0:1790895417.820352:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895417.822041:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1790895417.822135:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758835200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895417.822229:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758835200:12345-0@lo:400:kworker.0 Request processed in 177us (3341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895417.822236:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1790895417.822276:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835712 00000100:00100000:3.0:1790895417.822283:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835712 00000100:00100000:3.0:1790895417.822328:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790895417.822335:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758835712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895417.822369:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758835712:12345-0@lo:400:kworker.0 Request processed in 35us (3418us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895417.822374:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1790895417.822434:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758835328:0@lo:400:kworker.0 00000100:00100000:3.0:1790895417.822445:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc27100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758835200:0@lo:400:kworker.0 00010000:00080000:3.0:1790895417.822459:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc26300 x1877889758835712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895417.822470:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc26300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758835712:0@lo:400:kworker.0 00000100:00080000:1.0:1790895417.823032:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790895418.073652:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895418.329988:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758835840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895418.330055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895418.330137:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835840 00000100:00100000:2.0:1790895418.330146:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835840 00000100:00100000:2.0:1790895418.330189:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790895418.330198:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758835840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790895418.330233:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895418.330275:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758835840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895418.330283:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1790895418.330320:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3077a9880 x1877889758835840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895418.330457:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758835840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1790895419.106138:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895420.120847:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895421.144351:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895421.328246:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895421.328328:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977536 00000100:00100000:2.0:1790895421.328340:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977536 00000100:00100000:2.0:1790895421.328387:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 225 00000100:00100000:2.0:1790895421.328398:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740977536:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895421.328473:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740977536:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 76us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895421.328480:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 225 00000100:00100000:3.0:1790895421.336111:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895421.336189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895421.339211:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895421.339296:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895421.339602:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977664 00000100:00100000:2.0:1790895421.339613:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977664 00000100:00100000:2.0:1790895421.339678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977792 00000100:00100000:2.0:1790895421.339682:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977792 00000100:00100000:2.0:1790895421.339708:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:2.0:1790895421.339718:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740977664:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895421.339802:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889740977664:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 74us (3690us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895421.339810:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:2.0:1790895421.339828:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 79 00000100:00100000:2.0:1790895421.339835:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740977792:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895421.339878:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740977792:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 24us (3670us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895421.339885:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 79 00000100:00100000:2.0:1790895421.339985:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740977920 00000100:00100000:2.0:1790895421.339989:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740977920 00000100:00100000:2.0:1790895421.340014:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978048 00000100:00100000:2.0:1790895421.340016:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978048 00000100:00100000:2.0:1790895421.340037:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:2.0:1790895421.340044:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2360:x1877889740977920:12345-192.168.201.54@tcp:9:kworker.0 00000020:00000080:2.0:1790895421.340075:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8789 00000100:00080000:2.0:1790895421.340084:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf318f07000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790895421.340120:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790895421.340445:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+2:2360:x1877889740977920:12345-192.168.201.54@tcp:9:kworker.0 Request processed in 399us (1242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895421.340452:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:2.0:1790895421.340466:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:2.0:1790895421.340472:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2360:x1877889740978048:12345-192.168.201.54@tcp:9:kworker.0 00000020:00000080:2.0:1790895421.340483:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8790 00000100:00080000:2.0:1790895421.340488:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf336dc2800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790895421.340506:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1790895421.340741:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+2:2360:x1877889740978048:12345-192.168.201.54@tcp:9:kworker.0 Request processed in 268us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895421.340747:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00010000:00010000:2.0:1790895421.340771:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1790895421.340969:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790895421.340982:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790895421.340984:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790895421.340996:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1790895421.998040:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6eb9aba8-c466-4e48-9c75-9d75f799e495 00000020:00000080:2.0:1790895421.998050:0:6715:0:(genops.c:885:class_export_put()) final put ffff8cf318f05800/6eb9aba8-c466-4e48-9c75-9d75f799e495 00000020:00000080:2.0:1790895421.998094:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf318f05800/6eb9aba8-c466-4e48-9c75-9d75f799e495 for lustre-OST0000 00000020:00000080:2.0:1790895421.998148:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf318f07000 for lustre-OST0000 00000001:02000400:1.0:1790895422.062448:0:11020:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1790895422.168038:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895422.936943:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895422.936966:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895422.937033:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895422.937100:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758835968 00000100:00100000:2.0:1790895422.937108:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758835968 00000100:00100000:2.0:1790895422.937174:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790895422.937184:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758835968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895422.937229:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895422.937273:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758835968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895422.937281:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1790895422.937302:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1790895422.937331:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33a817b80 x1877889758835968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895422.937349:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758835968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895422.940935:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758836096:0@lo:400:kworker.0 00000100:00100000:3.0:1790895422.941021:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895422.941132:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758836096 00000100:00100000:1.0:1790895422.941143:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758836096 00000100:00100000:1.0:1790895422.941752:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1790895422.941772:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758836096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.946597:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758836224:0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.946676:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895422.946717:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895422.946725:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758836352:0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.946762:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895422.946816:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758836224 00000100:00100000:2.0:1790895422.946824:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758836224 00000100:00100000:2.0:1790895422.946887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758836352 00000100:00100000:2.0:1790895422.946890:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758836352 00000100:00100000:2.0:1790895422.946920:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790895422.946929:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758836224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.946977:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758836224:12345-0@lo:400:kworker.0 Request processed in 49us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895422.946984:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1790895422.946998:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1790895422.947004:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758836352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947027:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758836352:12345-0@lo:400:kworker.0 Request processed in 24us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895422.947038:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1790895422.947057:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895422.947085:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758836352:0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947094:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758836224:0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947169:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758836480:0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947197:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895422.947214:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895422.947220:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758836608:0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947241:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895422.947266:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758836608 00000100:00100000:2.0:1790895422.947269:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758836608 00000100:00100000:2.0:1790895422.947295:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790895422.947301:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758836608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947328:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758836608:12345-0@lo:400:kworker.0 Request processed in 28us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895422.947335:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1790895422.947351:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790895422.947367:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3077abb80 x1877889758836608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895422.947378:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758836608:0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947573:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758836480 00000100:00100000:2.0:1790895422.947579:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758836480 00000100:00100000:1.0:1790895422.947587:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758836096:12345-0@lo:400:kworker.0 Request processed in 5822us (6561us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895422.947599:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1790895422.947613:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1790895422.947620:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758836480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895422.947658:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758836480:12345-0@lo:400:kworker.0 Request processed in 38us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895422.947673:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1790895422.947689:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895422.947705:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758836480:0@lo:400:kworker.0 00000100:00100000:3.0:1790895422.948902:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758836096:0@lo:400:kworker.0 00010000:00010000:3.0:1790895423.192167:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895423.455921:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758836736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790895423.455994:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895423.458281:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758836736 00000100:00100000:1.0:1790895423.458294:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758836736 00000100:00100000:1.0:1790895423.458350:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790895423.458361:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758836736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790895423.458398:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895423.458669:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758836736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 309us (2673us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895423.458677:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:0.0:1790895423.461679:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc24a80 x1877889758836736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895439 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895423.462177:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758836736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790895424.219345:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895425.241745:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790895425.453984:0:11168:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0bad6190 20000000:00000080:2.0:1790895425.454000:0:11168:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf30618bc00 uarg=0000000000000000 20000000:01000000:2.0:1790895425.454034:0:11168:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790895425.454040:0:11168:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1790895425.454057:0:11168:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1790895425.456200:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1790895425.456423:0:11168:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790895425.465278:0:11168:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790895425.465581:0:11168:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465673:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465685:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8743 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465694:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8751 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465701:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf875f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465730:0:11168:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465738:0:11168:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465782:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 12 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.465811:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 12 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895425.465827:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc27480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758836864:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895425.466427:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf875f expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.466438:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf875f expref: 18 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895425.466449:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758836992:0@lo:104: 00000100:00100000:3.0:1790895425.466501:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790895425.466543:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8751 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.466551:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8751 expref: 18 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895425.466560:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758837120:0@lo:104: 00000100:00100000:3.0:1790895425.466589:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790895425.466627:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf8743 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.466637:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf8743 expref: 18 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895425.466645:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758837248:0@lo:104: 00000100:00100000:3.0:1790895425.466665:0:11168:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895425.466693:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758836992 00000100:00100000:3.0:1790895425.466699:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758836992 00000100:00100000:3.0:1790895425.466745:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758837120 00000100:00100000:3.0:1790895425.466748:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758837120 00000100:00100000:3.0:1790895425.466759:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758837248 00000100:00100000:3.0:1790895425.466761:0:5815:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758837248 00000100:00100000:3.0:1790895425.466773:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790895425.466782:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+5:11168:x1877889758836992:12345-0@lo:104: 00010000:00010000:3.0:1790895425.466794:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.466837:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1790895425.466843:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+5:11168:x1877889758836992:12345-0@lo:104: Request processed in 62us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895425.466849:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790895425.466890:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790895425.466897:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:11168:x1877889758837120:12345-0@lo:104: 00010000:00010000:3.0:1790895425.466904:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.466945:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1790895425.466951:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+4:11168:x1877889758837120:12345-0@lo:104: Request processed in 56us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895425.466958:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790895425.466985:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790895425.466991:0:5815:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+3:11168:x1877889758837248:12345-0@lo:104: 00010000:00010000:3.0:1790895425.466998:0:5815:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467024:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1790895425.467029:0:5815:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:221ad158-1cb7-4652-832e-1e3667184cca+3:11168:x1877889758837248:12345-0@lo:104: Request processed in 39us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895425.467035:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1790895425.467053:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790895425.467058:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467066:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf301523200 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895425.467070:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467078:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895425.467086:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895425.467092:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790895425.467125:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467131:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895425.467153:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467160:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf301523200/0x7911a98710cf875f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8766 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467174:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790895425.467177:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467183:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895425.467185:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467192:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895425.467198:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895425.467203:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790895425.467551:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467559:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1790895425.467606:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758837504:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790895425.467641:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1790895425.467683:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467701:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7cc00/0x7911a98710cf8751 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf8758 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467711:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895425.467714:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467728:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf301522200 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895425.467732:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467740:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895425.467747:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895425.467752:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1790895425.467787:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.467794:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790895425.467868:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895425.467873:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895425.469183:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790895425.469205:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758837376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790895425.469272:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895425.469327:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758837504 00000100:00100000:1.0:1790895425.469346:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758837504 00010000:00010000:1.0:1790895425.469377:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8751 expref: 19 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895425.469403:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758837376 00000100:00100000:1.0:1790895425.469406:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758837376 00010000:00010000:1.0:1790895425.469417:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf875f expref: 20 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895425.469431:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790895425.469438:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306507050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+20:3308:x1877889758837504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895425.469462:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895425.469469:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8751 expref: 20 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895425.469479:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8751 expref: 20 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895425.469498:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895425.469760:0:5816:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1790895425.469769:0:5816:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1790895425.469940:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790895425.469954:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+20:3310:x1877889758837376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895425.469975:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895425.469980:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf875f expref: 20 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.469989:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf875f expref: 20 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.470000:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895425.470031:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340685500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+20:3310:x1877889758837376:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895425.470038:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790895425.470163:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758837376:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895425.470259:0:11168:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.470271:0:11168:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 12 pid: 5826 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.470283:0:11168:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a814700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758837760:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895425.470333:0:11168:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8cc0 going to sleep for 11 seconds 00010000:00010000:0.0:1790895425.470348:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301522800/0x7911a98710cf8766 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf875f expref: 19 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.470360:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758836992:0@lo:104: 00010000:00010000:0.0:1790895425.470370:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7c600/0x7911a98710cf8758 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8751 expref: 18 pid: 5824 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.470389:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758837120:0@lo:104: 00000100:00100000:0.0:1790895425.470400:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758837248:0@lo:104: 00000100:00100000:0.0:1790895425.471751:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758837632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895425.471804:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895425.471843:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758837632 00000100:00100000:0.0:1790895425.471850:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758837632 00010000:00010000:0.0:1790895425.471894:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8743 expref: 18 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.471920:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790895425.471927:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+18:3309:x1877889758837632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895425.471939:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895425.471944:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf8743 expref: 18 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.471954:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf8743 expref: 18 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.471981:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301522000/0x7911a98710cf874a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf8743 expref: 18 pid: 5825 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.471996:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895425.472027:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a816a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+17:3309:x1877889758837632:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895425.472034:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790895425.472066:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758837632:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790895425.474206:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.474277:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf301522200/0x7911a98710cf8743 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf874a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895425.474302:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895425.474317:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895425.474320:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895425.474495:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895425.474887:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895425.474917:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978176 00000100:00100000:0.0:1790895425.474926:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978176 00010000:00010000:0.0:1790895425.474957:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 13 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.475044:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978304 00000100:00100000:0.0:1790895425.475047:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978304 00010000:00010000:0.0:1790895425.475063:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 14 pid: 5826 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.475077:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:0.0:1790895425.475086:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+14:2362:x1877889740978176:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895425.475098:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895425.475104:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 14 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475127:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 14 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475145:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895425.475193:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+14:2362:x1877889740978176:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 107us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895425.475200:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:0.0:1790895425.475283:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:0.0:1790895425.475290:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740978304:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895425.475297:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895425.475310:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 13 pid: 5826 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475322:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 13 pid: 5826 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475335:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475343:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475359:0:5817:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475365:0:5817:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475371:0:5817:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475377:0:5817:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475382:0:5817:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cbc00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895425.475386:0:5817:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475393:0:5817:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475400:0:5817:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.475417:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895425.475439:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740978304:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 149us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895425.475445:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 29 00010000:00010000:0.0:1790895425.476339:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf300031400/0x7911a98710cf877b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c3c expref: 12 pid: 5825 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.476357:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc27480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758836864:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895425.476370:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301523e00/0x7911a98710cf873c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c04 expref: 11 pid: 5826 timeout: 398 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895425.476381:0:11168:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a814700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11168:1877889758837760:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895425.476409:0:11168:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.476419:0:11168:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.476425:0:11168:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895425.476432:0:11168:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf3029cbc00/0x7911a98710cf8797 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895425.479489:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306507050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+16:3308:x1877889758837504:12345-0@lo:103:ldlm_bl.0 Request processed in 10043us (11839us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895425.479503:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1790895425.480933:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc25c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758837504:0@lo:103:ldlm_bl.0 00000001:00100000:2.0:1790895425.621928:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6eb9aba8-c466-4e48-9c75-9d75f799e495 00000020:00000080:2.0:1790895425.621937:0:7641:0:(genops.c:885:class_export_put()) final put ffff8cf336dc1000/6eb9aba8-c466-4e48-9c75-9d75f799e495 00000020:00000080:2.0:1790895425.621976:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf336dc1000/6eb9aba8-c466-4e48-9c75-9d75f799e495 for lustre-OST0001 00000020:00000080:2.0:1790895425.622022:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf336dc2800 for lustre-OST0001 00010000:00010000:0.0:1790895426.264426:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895426.442111:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895426.442156:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895426.442180:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895426.442319:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978432 00000100:00100000:2.0:1790895426.442329:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978432 00000100:00100000:2.0:1790895426.442391:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 227 00000100:00100000:2.0:1790895426.442401:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+11:2362:x1877889740978432:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895426.442470:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+11:2362:x1877889740978432:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 70us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.442477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 227 00000100:00100000:2.0:1790895426.442512:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978688 00000100:00100000:2.0:1790895426.442527:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978688 00000100:00100000:2.0:1790895426.442561:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978560 00000100:00100000:2.0:1790895426.442564:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978560 00000100:00100000:2.0:1790895426.442584:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 83 00000100:00100000:2.0:1790895426.442591:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740978688:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895426.442622:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740978688:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 32us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.442628:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 83 00000100:00100000:2.0:1790895426.442640:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:2.0:1790895426.442647:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740978560:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895426.442670:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889740978560:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 24us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.442676:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00080000:2.0:1790895426.442828:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1790895426.583926:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790895426.583935:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf332953800 from 7 10000000:01000000:2.0:1790895426.583949:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790895426.583998:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.584009:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.584020:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895426.584045:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758837888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.584118:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895426.584181:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895426.584203:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758837888 00000100:00100000:2.0:1790895426.584210:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758837888 00000100:00100000:2.0:1790895426.584260:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790895426.584268:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758837888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895426.584289:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895426.584302:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf879e expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.584325:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf879e expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.584335:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf879e expref: 17 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.584344:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fc00, rc 0) 00000100:00100000:2.0:1790895426.584379:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758837888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.584385:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1790895426.584444:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758837888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895426.584457:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.584466:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895426.584517:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.584543:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895426.584563:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895426.584576:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838016 00000100:00100000:2.0:1790895426.584580:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838016 00000100:00100000:2.0:1790895426.584599:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790895426.584604:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758838016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.584842:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758838016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.584849:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1790895426.584899:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.584925:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.584957:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895426.584977:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895426.584989:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838144 00000100:00100000:2.0:1790895426.584992:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838144 00000100:00100000:2.0:1790895426.585011:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790895426.585017:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758838144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.585142:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758838144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.585148:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1790895426.585185:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790895426.585880:0:11195:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790895426.585928:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790895426.585944:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895426.585952:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.585973:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895426.585984:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790895426.585986:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf310bbd000 from 7 10000000:01000000:2.0:1790895426.585988:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790895426.586011:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.586018:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.586027:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895426.586042:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.586077:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895426.586101:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895426.586114:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838272 00000100:00100000:2.0:1790895426.586118:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838272 00000100:00100000:2.0:1790895426.586143:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1790895426.586149:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758838272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895426.586159:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895426.586169:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf87ac expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.586187:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf87ac expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.586207:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf87ac expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.586215:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f000, rc 0) 00000100:00100000:2.0:1790895426.586260:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758838272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.586267:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1790895426.586301:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895426.586312:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.586321:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895426.586360:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.586384:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895426.586396:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895426.586407:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838400 00000100:00100000:2.0:1790895426.586411:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838400 00000100:00100000:2.0:1790895426.586430:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1790895426.586436:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758838400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.586638:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758838400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 201us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.586645:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1790895426.586674:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.586720:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.586760:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895426.586773:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b90c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895426.586786:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838528 00000100:00100000:2.0:1790895426.586789:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838528 00000100:00100000:2.0:1790895426.586809:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790895426.586814:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758838528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.586958:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758838528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895426.586964:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1790895426.587001:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1790895426.587676:0:11196:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1790895426.591019:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1790895426.591049:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895426.591060:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.591073:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895426.591083:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1790895426.591085:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf303072000 from 7 10000000:01000000:2.0:1790895426.591157:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1790895426.591193:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.591200:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895426.591229:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895426.591379:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1790895426.591567:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895426.591612:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b9780 going to sleep for 11 seconds 00000100:00100000:1.0:1790895426.593546:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838656 00000100:00100000:1.0:1790895426.593559:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838656 00000100:00100000:1.0:1790895426.593619:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1790895426.593629:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758838656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895426.593644:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895426.593661:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf87ba expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895426.593717:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf87ba expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895426.593729:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf87ba expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895426.593738:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d200, rc 0) 00000100:00100000:1.0:1790895426.593798:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758838656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895426.593803:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1790895426.595938:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895426.595978:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895426.595990:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895426.596070:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895426.596133:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895426.596168:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8240 going to sleep for 11 seconds 00000100:00100000:1.0:1790895426.596824:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838784 00000100:00100000:1.0:1790895426.596837:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838784 00000100:00100000:1.0:1790895426.596904:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1790895426.596914:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758838784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895426.597381:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758838784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 468us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895426.597388:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1790895426.597492:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895426.597531:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895426.597572:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895426.597607:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf2018a8240 going to sleep for 11 seconds 00000100:00100000:1.0:1790895426.597653:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758838912 00000100:00100000:1.0:1790895426.597658:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758838912 00000100:00100000:1.0:1790895426.601805:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1790895426.601826:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758838912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895426.602089:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758838912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 271us (4515us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895426.602097:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1790895426.602190:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758838912:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1790895426.606781:0:11197:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1790895426.606839:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1790895426.606876:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790895426.606888:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895426.606900:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895427.290269:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895427.468063:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895427.469526:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978816 00000100:00100000:2.0:1790895427.469540:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978816 00000100:00100000:2.0:1790895427.469589:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 237 00000100:00100000:2.0:1790895427.469599:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+11:5602:x1877889740978816:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895427.469617:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895427.469635:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c66 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895427.469662:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895427.469674:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895427.469684:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e400, rc 0) 00000100:00100000:2.0:1790895427.469765:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740978816:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 168us (1715us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895427.469773:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 237 00000100:00100000:0.0:1790895427.472358:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895427.472440:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740978944 00000100:00100000:1.0:1790895427.472458:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740978944 00000100:00100000:1.0:1790895427.472514:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 238 00000100:00100000:1.0:1790895427.472524:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740978944:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895427.472834:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740978944:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 311us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895427.472842:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 238 00000100:00100000:3.0:1790895427.477103:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895427.480130:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979072 00000100:00100000:2.0:1790895427.480145:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979072 00000100:00100000:2.0:1790895427.480268:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 239 00000100:00100000:2.0:1790895427.480286:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740979072:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895427.480503:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740979072:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 219us (3407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895427.480511:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 239 00000100:00100000:0.0:1790895427.485635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895427.486054:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979200 00000100:00100000:3.0:1790895427.486069:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979200 00000100:00100000:3.0:1790895427.486125:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 240 00000100:00100000:3.0:1790895427.486136:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740979200:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895427.486155:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895427.486187:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c6d expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895427.486217:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895427.486229:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895427.486239:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029ca000, rc 0) 00000100:00100000:3.0:1790895427.486300:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740979200:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 165us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895427.486307:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 240 00000100:00100000:3.0:1790895427.488548:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895427.488583:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979328 00000100:00100000:3.0:1790895427.488592:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979328 00000100:00100000:3.0:1790895427.488632:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 241 00000100:00100000:3.0:1790895427.488640:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740979328:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895427.488941:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740979328:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 300us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895427.488959:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 241 00000100:00100000:3.0:1790895427.501907:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895427.504594:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979456 00000100:00100000:1.0:1790895427.504608:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979456 00000100:00100000:1.0:1790895427.504664:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 242 00000100:00100000:1.0:1790895427.504674:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740979456:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895427.504932:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740979456:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 260us (3035us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895427.504940:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 242 00000100:00100000:2.0:1790895428.056095:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758839040:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056162:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895428.056204:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758839552:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056226:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895428.056248:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790895428.056253:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758839168:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056271:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895428.056285:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758839680:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056307:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895428.056328:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758839296:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056346:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895428.056363:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895428.056367:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758839424:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056387:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895428.056413:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839040 00000100:00100000:2.0:1790895428.056421:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839040 00000100:00100000:2.0:1790895428.056461:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790895428.056470:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758839040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056519:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758839040:12345-0@lo:400:kworker.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895428.056526:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1790895428.056568:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839552 00000100:00100000:2.0:1790895428.056572:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839552 00000100:00100000:2.0:1790895428.056606:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839168 00000100:00100000:2.0:1790895428.056609:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839168 00000100:00100000:2.0:1790895428.056619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839296 00000100:00100000:2.0:1790895428.056621:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839296 00000100:00100000:2.0:1790895428.056636:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790895428.056642:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758839552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056673:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758839552:12345-0@lo:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895428.056689:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1790895428.056701:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790895428.056707:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758839168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056733:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758839168:12345-0@lo:400:kworker.0 Request processed in 27us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895428.056739:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1790895428.056749:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790895428.056755:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758839296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056784:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758839296:12345-0@lo:400:kworker.0 Request processed in 29us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895428.056790:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1790895428.056811:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839680 00000100:00100000:2.0:1790895428.056814:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839680 00000100:00100000:2.0:1790895428.056849:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839424 00000100:00100000:2.0:1790895428.056853:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839424 00000100:00100000:2.0:1790895428.056896:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790895428.056902:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3101d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758839680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.056931:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3101d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758839680:12345-0@lo:400:kworker.0 Request processed in 30us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895428.056943:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790895428.057083:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1790895428.057091:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758839424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.057121:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758839424:12345-0@lo:400:kworker.0 Request processed in 31us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895428.057127:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1790895428.057150:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790895428.057154:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895428.057156:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790895428.057191:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3060c3480 x1877889758839424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895428.057204:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758839424:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.057216:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758839296:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.057245:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758839168:0@lo:400:kworker.0 00010000:00080000:2.0:1790895428.057255:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3060c3800 x1877889758839680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895428.057263:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758839680:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.057270:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758839040:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.057278:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758839552:0@lo:400:kworker.0 00000100:00100000:2.0:1790895428.059170:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758839808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895428.059233:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895428.059340:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839808 00000100:00100000:1.0:1790895428.059347:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839808 00000100:00100000:1.0:1790895428.059399:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790895428.059409:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758839808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790895428.059445:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895428.059495:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758839808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895428.059503:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1790895428.059543:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf340686300 x1877889758839808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895428.059560:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758839808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790895428.314296:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895428.569387:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895428.569423:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758839936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895428.569490:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895428.570020:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758839936 00000100:00100000:3.0:1790895428.570030:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758839936 00000100:00100000:3.0:1790895428.570093:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790895428.570103:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758839936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895428.570141:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895428.570420:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758839936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 319us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895428.570428:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1790895428.570730:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf340659500 x1877889758839936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895444 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895428.570749:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758839936:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895429.343122:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790895429.782369:0:11368:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790895430.360304:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895431.385341:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895431.578273:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895431.578371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895431.578407:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895431.578454:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979712 00000100:00100000:3.0:1790895431.578470:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979712 00000100:00100000:3.0:1790895431.578566:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979840 00000100:00100000:3.0:1790895431.578571:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979840 00000100:00100000:2.0:1790895431.578655:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979584 00000100:00100000:2.0:1790895431.578660:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979584 00000100:00100000:2.0:1790895431.578696:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 244 00000100:00100000:2.0:1790895431.578707:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889740979584:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895431.578803:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889740979584:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 98us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895431.578812:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 244 00000100:00080000:2.0:1790895431.578909:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895431.578973:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 88 00000100:00100000:3.0:1790895431.578983:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740979712:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895431.579025:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740979712:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 44us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895431.579031:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 88 00000100:00100000:3.0:1790895431.579045:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 89 00000100:00100000:3.0:1790895431.579050:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740979840:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895431.579079:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740979840:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 29us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895431.579105:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 89 00010000:00010000:0.0:1790895432.408159:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895433.176221:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758840448:0@lo:400:kworker.0 00000100:00100000:1.0:1790895433.176293:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895433.176357:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790895433.176363:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758840320:0@lo:400:kworker.0 00000100:00100000:1.0:1790895433.176390:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895433.176423:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840448 00000100:00100000:1.0:1790895433.176431:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840448 00000100:00100000:1.0:1790895433.176488:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790895433.176497:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758840448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895433.176547:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758840448:12345-0@lo:400:kworker.0 Request processed in 52us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895433.176555:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790895433.176578:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840320 00000100:00100000:1.0:1790895433.176582:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840320 00000100:00100000:1.0:1790895433.176626:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1790895433.176633:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758840320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895433.176666:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758840320:12345-0@lo:400:kworker.0 Request processed in 33us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895433.176672:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1790895433.176689:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790895433.176693:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895433.176728:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758840320:0@lo:400:kworker.0 00010000:00080000:1.0:1790895433.176740:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf340685f80 x1877889758840448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895433.176751:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340685f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758840448:0@lo:400:kworker.0 00000100:00100000:0.0:1790895433.176982:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758840192:0@lo:400:kworker.0 00000100:00100000:0.0:1790895433.177015:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895433.177035:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758840704:0@lo:400:kworker.0 00000100:00100000:0.0:1790895433.177057:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895433.177085:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1790895433.177091:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758840064:0@lo:400:kworker.0 00000100:00100000:0.0:1790895433.177116:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895433.177136:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758840576:0@lo:400:kworker.0 00000100:00100000:0.0:1790895433.177156:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895433.177189:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840704 00000100:00100000:0.0:1790895433.177194:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840704 00000100:00100000:0.0:1790895433.177223:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1790895433.177230:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758840704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895433.177266:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758840704:12345-0@lo:400:kworker.0 Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895433.177273:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1790895433.177302:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf340687480 x1877889758840704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895433.177313:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758840704:0@lo:400:kworker.0 00000100:00100000:3.0:1790895433.177373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840192 00000100:00100000:3.0:1790895433.177378:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840192 00000100:00100000:3.0:1790895433.177411:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840576 00000100:00100000:3.0:1790895433.177414:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840576 00000100:00100000:3.0:1790895433.177433:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790895433.177440:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758840192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895433.177479:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758840192:12345-0@lo:400:kworker.0 Request processed in 39us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895433.177485:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1790895433.177497:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790895433.177503:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758840576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895433.177528:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758840576:12345-0@lo:400:kworker.0 Request processed in 25us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895433.177533:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1790895433.177560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758840576:0@lo:400:kworker.0 00000100:00100000:3.0:1790895433.177569:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340685180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758840192:0@lo:400:kworker.0 00000100:00100000:1.0:1790895433.178171:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840064 00000100:00100000:1.0:1790895433.178178:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840064 00000100:00100000:1.0:1790895433.178216:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790895433.178224:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758840064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895433.178263:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758840064:12345-0@lo:400:kworker.0 Request processed in 40us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895433.178269:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1790895433.178295:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790895433.178298:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790895433.178418:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758840064:0@lo:400:kworker.0 00000100:00100000:1.0:1790895433.179208:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758840832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895433.179250:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895433.179328:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840832 00000100:00100000:2.0:1790895433.179334:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840832 00000100:00100000:2.0:1790895433.179364:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1790895433.179372:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758840832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895433.179404:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895433.179453:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758840832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895433.179459:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1790895433.179640:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33a814000 x1877889758840832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895433.179657:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758840832:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790895433.432142:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895433.691709:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895433.691743:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758840960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790895433.691816:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895433.694841:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758840960 00000100:00100000:2.0:1790895433.694873:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758840960 00000100:00100000:2.0:1790895433.694928:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790895433.694939:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758840960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790895433.694978:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895433.695068:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758840960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (3251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895433.695075:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1790895433.695119:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3060c3800 x1877889758840960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895449 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895433.695142:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758840960:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1790895433.738212:0:11468:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 18:57:12 (1790895432) === 00000100:00100000:3.0:1790895434.040653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895434.040725:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.040908:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740979968 00000100:00100000:0.0:1790895434.040923:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740980096 00000100:00100000:2.0:1790895434.040928:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740979968 00000100:00100000:0.0:1790895434.040935:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740980096 00000100:00100000:0.0:1790895434.041017:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:2.0:1790895434.041038:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:0.0:1790895434.041040:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9690:x1877889740980096:12345-192.168.201.54@tcp:700:mkdir.0 00000100:00100000:2.0:1790895434.041060:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889740979968:12345-192.168.201.54@tcp:41:mkdir.0 00000004:00000024:2.0:1790895434.041112:0:5832:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790895434.041195:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9690:x1877889740980096:12345-192.168.201.54@tcp:700:mkdir.0 Request processed in 162us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895434.041206:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:2.0:1790895434.041254:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889740979968:12345-192.168.201.54@tcp:41:mkdir.0 Request processed in 201us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895434.041263:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00080000:1.0:1790895434.041373:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895434.048153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895434.048261:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740980352 00000100:00100000:0.0:1790895434.048274:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740980352 00000100:00100000:0.0:1790895434.048400:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:0.0:1790895434.048412:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:9690:x1877889740980352:12345-192.168.201.54@tcp:36:mkdir.0 00010000:00010000:0.0:1790895434.048478:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895434.048556:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf86b7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bef expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.048590:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:0.0:1790895434.048603:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895434.049029:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.049043:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.049053:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.049082:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.049098:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.049106:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895434.050272:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1790895434.050289:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.050298:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.050307:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.050313:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895434.050317:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.050326:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.050338:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:0.0:1790895434.050342:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895434.050346:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.050353:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf87d6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895434.050381:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000432f03da reply state 0000000087746b61 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895434.050389:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790895434.050499:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9690:x1877889740980352:12345-192.168.201.54@tcp:36:mkdir.0 Request processed in 2084us (2351us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1790895434.050509:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00010000:00010000:3.0:1790895434.057773:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.057797:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.057828:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.057835:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895434.057840:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.057848:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.057887:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf31037c400) 00010000:00010000:3.0:1790895434.057891:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895434.057897:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.057903:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf87dd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895434.070559:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895434.070723:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740980480 00000100:00100000:3.0:1790895434.070736:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740980480 00000100:00100000:3.0:1790895434.070814:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:3.0:1790895434.070841:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:9691:x1877889740980480:12345-192.168.201.54@tcp:101:chmod.0 00010000:00010000:3.0:1790895434.070904:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895434.070930:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf87e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c74 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.071154:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf87eb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.071169:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf87eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.071185:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf87eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895434.071223:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790895434.071228:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895434.071269:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf87eb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.071315:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf87e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c74 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.071336:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf87eb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c74 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.071346:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:2.0:1790895434.071349:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895434.071353:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f200, rc 0) 00000100:00100000:2.0:1790895434.071439:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9691:x1877889740980480:12345-192.168.201.54@tcp:101:chmod.0 Request processed in 599us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895434.071447:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:1.0:1790895434.076736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.076893:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740980736 00000100:00100000:2.0:1790895434.076905:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740980736 00000100:00100000:2.0:1790895434.076982:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:2.0:1790895434.076993:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9691:x1877889740980736:12345-192.168.201.54@tcp:36:chmod.0 00010000:00010000:2.0:1790895434.077058:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895434.077087:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf87eb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c74 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.077110:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:2.0:1790895434.077122:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895434.077151:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.077165:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.077195:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790895434.078668:0:7639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdd1a526 reply state 00000000da484750 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895434.078685:0:7639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1790895434.078697:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790895434.078824:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+8:9691:x1877889740980736:12345-192.168.201.54@tcp:36:chmod.0 Request processed in 1830us (2098us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1790895434.078834:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00010000:00010000:1.0:1790895434.089877:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.089898:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.089907:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.089915:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.089935:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.089945:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.089966:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf310c7ed00) 00010000:00010000:1.0:1790895434.089970:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790895434.089975:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.089982:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf87f2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.110269:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895434.110845:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740980864 00000100:00100000:0.0:1790895434.110896:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740980864 00000100:00100000:0.0:1790895434.111302:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:0.0:1790895434.111314:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9692:x1877889740980864:12345-192.168.201.54@tcp:101:chown.0 00010000:00010000:0.0:1790895434.111340:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895434.111361:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf87f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c7b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.111440:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8800 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.111464:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.111476:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895434.111515:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790895434.111520:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895434.111563:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8800 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.111622:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf87f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c7b expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.111640:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8800 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c7b expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.111649:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:0.0:1790895434.111651:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895434.111655:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7de00, rc 0) 00000100:00100000:0.0:1790895434.111730:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:9692:x1877889740980864:12345-192.168.201.54@tcp:101:chown.0 Request processed in 419us (1475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895434.111738:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:2.0:1790895434.116248:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895434.116355:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740980992 00000100:00100000:0.0:1790895434.116368:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740980992 00000100:00100000:0.0:1790895434.116443:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:0.0:1790895434.116455:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:9692:x1877889740980992:12345-192.168.201.54@tcp:101:chown.0 00010000:00010000:0.0:1790895434.116486:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895434.116512:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8807 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c82 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116597:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116612:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116624:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116655:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116663:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116669:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116770:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf881c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116778:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf881c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116785:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf881c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895434.116818:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790895434.116822:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895434.116840:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf881c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116852:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116891:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116908:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116926:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895434.116930:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116939:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116952:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:0.0:1790895434.116955:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895434.116960:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116966:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf880e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116981:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116987:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116993:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.116998:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895434.117003:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.117008:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.117025:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf31037c800) 00010000:00010000:0.0:1790895434.117028:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895434.117031:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.117037:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8815 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.117069:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8807 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c82 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.117082:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf881c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c82 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.117089:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895434.117091:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895434.117093:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7da00, rc 0) 00000100:00100000:0.0:1790895434.117147:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:9692:x1877889740980992:12345-192.168.201.54@tcp:101:chown.0 Request processed in 696us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895434.117153:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:1.0:1790895434.129155:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.129287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740981248 00000100:00100000:2.0:1790895434.129298:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740981248 00000100:00100000:2.0:1790895434.129352:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:2.0:1790895434.129363:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:9692:x1877889740981248:12345-192.168.201.54@tcp:36:chown.0 00010000:00010000:2.0:1790895434.129412:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895434.129437:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf881c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c82 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.129458:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:2.0:1790895434.129468:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895434.129493:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.129505:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.129515:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895434.227074:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000004:00010000:1.0:1790895434.227171:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c9af7cee reply state 0000000069424f9a transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.227189:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790895434.227208:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790895434.227363:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:9692:x1877889740981248:12345-192.168.201.54@tcp:36:chown.0 Request processed in 97996us (98211us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1790895434.227378:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00000001:00080000:1.0:1790895434.227436:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:3.0:1790895434.227559:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.227611:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.227619:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.227626:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895434.227632:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.227643:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.227663:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf310c7e600) 00010000:00010000:3.0:1790895434.227666:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790895434.227673:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.227680:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8823 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.250639:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.251028:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740981376 00000100:00100000:2.0:1790895434.251043:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740981376 00000100:00100000:2.0:1790895434.251131:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:2.0:1790895434.251144:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:9693:x1877889740981376:12345-192.168.201.54@tcp:101:touch.500 00010000:00010000:2.0:1790895434.251178:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895434.251207:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf882a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c89 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790895434.256947:0:7639:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5673us 00010000:00010000:1.0:1790895434.286188:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286220:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286241:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286260:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286267:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286273:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286794:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf883f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286804:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf883f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286811:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf883f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895434.286841:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790895434.286846:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895434.286936:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf883f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286952:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286958:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286975:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.286981:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.286985:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.287908:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.287936:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:1.0:1790895434.287940:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.287949:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.287957:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8831 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.287976:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.287982:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.287987:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.288066:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.288070:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.288091:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.288100:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf314095300) 00010000:00010000:1.0:1790895434.288102:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.288105:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.288176:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8838 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.288241:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf882a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c89 expref: 8 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.288261:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf883f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c89 expref: 7 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.288269:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.288272:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790895434.288275:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c600, rc 0) 00000100:00100000:1.0:1790895434.288382:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9693:x1877889740981376:12345-192.168.201.54@tcp:101:touch.500 Request processed in 37239us (37754us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895434.288394:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:1.0:1790895434.292848:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895434.293118:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740981632 00000100:00100000:0.0:1790895434.293133:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740981632 00000100:00100000:0.0:1790895434.293200:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:0.0:1790895434.293209:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9693:x1877889740981632:12345-192.168.201.54@tcp:101:touch.500 00010000:00010000:0.0:1790895434.293234:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895434.293256:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf8846 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c90 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.293698:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.293718:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.293733:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.293751:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.293758:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.293766:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790895434.298631:0:5831:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1790895434.299263:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf885b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299300:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf885b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299318:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf885b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299371:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299379:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299387:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299394:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.299399:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299409:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299423:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.299427:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.299433:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299440:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf884d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895434.299454:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a4f6d1c5 reply state 00000000929a412d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.299469:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790895434.299517:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c400/0x7911a98710cf8846 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c90 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299533:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf885b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c90 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.299540:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf314095500) 00010000:00010000:1.0:1790895434.299542:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895434.299545:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ca00, rc 0) 00000100:00100000:1.0:1790895434.299665:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340686a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+10:9693:x1877889740981632:12345-192.168.201.54@tcp:101:touch.500 Request processed in 6455us (6833us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790895434.299675:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 22 00010000:00010000:3.0:1790895434.304286:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.304312:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.304322:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.304330:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895434.304364:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.304374:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.304397:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff8cf31037c900) 00010000:00010000:3.0:1790895434.304401:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895434.304408:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.304416:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8854 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.305509:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895434.305736:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740981888 00000100:00100000:0.0:1790895434.305751:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740981888 00000100:00100000:0.0:1790895434.305829:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:0.0:1790895434.305842:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:9693:x1877889740981888:12345-192.168.201.54@tcp:36:touch.500 00010000:00010000:0.0:1790895434.305950:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895434.305979:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf885b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c90 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.305998:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf314095500) 00010000:00010000:0.0:1790895434.306009:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895434.306090:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.306113:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.306125:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895434.306297:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000174d9a71 reply state 000000004c9d4f2a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895434.306307:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790895434.306424:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+10:9693:x1877889740981888:12345-192.168.201.54@tcp:36:touch.500 Request processed in 586us (925us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790895434.306432:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00010000:00010000:1.0:1790895434.315900:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.315923:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.315932:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.315939:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.315945:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.315954:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.316001:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:1.0:1790895434.316004:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.316011:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.316019:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8869 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.316724:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.316820:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740982016 00000100:00100000:2.0:1790895434.316834:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740982016 00000100:00100000:2.0:1790895434.316938:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:2.0:1790895434.316951:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:9693:x1877889740982016:12345-192.168.201.54@tcp:101:touch.500 00010000:00010000:2.0:1790895434.317000:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895434.317027:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8870 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c97 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.317115:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c97 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.317137:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8870 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c97 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.317160:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf310c7ef00) 00010000:00010000:2.0:1790895434.317163:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790895434.317166:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e000, rc 0) 00000100:00100000:2.0:1790895434.317248:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+10:9693:x1877889740982016:12345-192.168.201.54@tcp:101:touch.500 Request processed in 299us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895434.317268:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:0.0:1790895434.320840:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895434.321001:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740982144 00000100:00100000:1.0:1790895434.321014:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740982144 00000100:00100000:1.0:1790895434.321081:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:1.0:1790895434.321091:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2360:x1877889740982144:12345-192.168.201.54@tcp:8:touch.500 00010000:00080000:1.0:1790895434.321135:0:8701:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:1.0:1790895434.321181:0:8701:0:(genops.c:1384:class_connect()) connect: client 5979f259-4636-4129-bc0f-4cbabdd61a69, cookie 0x7911a98710cf8877 00002000:00100000:1.0:1790895434.321198:0:8701:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5979f259-4636-4129-bc0f-4cbabdd61a69/ffff8cf3368a3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790895434.321211:0:8701:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790895434.321531:0:8701:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1790895434.321585:0:8701:0:(import.c:65:import_set_state_nolock()) ffff8cf3368a6800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895434.321685:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2360:x1877889740982144:12345-192.168.201.54@tcp:8:touch.500 Request processed in 593us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895434.321694:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1790895434.329489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.329717:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740982272 00000100:00100000:2.0:1790895434.329732:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740982272 00000100:00100000:2.0:1790895434.329841:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:2.0:1790895434.329853:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:0:x1877889740982272:12345-192.168.201.54@tcp:2:touch.500 00000100:00080000:1.0:1790895434.330214:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1790895434.424601:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000001:00080000:0.0:1790895434.424622:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1790895434.424817:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:0:x1877889740982272:12345-192.168.201.54@tcp:2:touch.500 Request processed in 94960us (95336us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1790895434.424828:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:1.0:1790895434.431356:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.431455:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740982528 00000100:00100000:2.0:1790895434.431468:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740982528 00000100:00100000:2.0:1790895434.431529:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:2.0:1790895434.431540:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+10:9693:x1877889740982528:12345-192.168.201.54@tcp:35:touch.500 00000100:00100000:2.0:1790895434.433028:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+11:9693:x1877889740982528:12345-192.168.201.54@tcp:35:touch.500 Request processed in 1180us (1373us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1790895434.433043:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00010000:00010000:0.0:1790895434.462217:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895434.481791:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895434.481945:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740982656 00000100:00100000:1.0:1790895434.481955:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740982656 00000100:00100000:1.0:1790895434.482018:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:1.0:1790895434.482041:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+11:9694:x1877889740982656:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:1.0:1790895434.482073:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895434.482095:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf887e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2c9e expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.482163:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf8885 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.482177:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf8885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.482189:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf8885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895434.482224:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1790895434.482227:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895434.482266:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf8885 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.482292:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf887e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c9e expref: 13 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.482313:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf8885 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c9e expref: 12 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.482322:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.482326:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790895434.482330:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c200, rc 0) 00000100:00100000:1.0:1790895434.482395:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+12:9694:x1877889740982656:12345-192.168.201.54@tcp:101:rm.0 Request processed in 356us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895434.482412:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:0.0:1790895434.490081:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895434.490260:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740982912 00000100:00100000:3.0:1790895434.490274:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740982912 00000100:00100000:2.0:1790895434.490412:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:2.0:1790895434.490431:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+12:9694:x1877889740982912:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:2.0:1790895434.490453:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895434.490475:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf888c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ca5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895434.490577:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790895434.490754:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf888c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ca5 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.490782:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:2.0:1790895434.490784:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790895434.490790:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf888c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ca5 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895434.490806:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e200, rc 0) 00000100:00100000:2.0:1790895434.490909:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+13:9694:x1877889740982912:12345-192.168.201.54@tcp:101:rm.0 Request processed in 485us (842us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1790895434.490918:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:2.0:1790895434.500253:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895434.500368:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740983040 00000100:00100000:1.0:1790895434.500383:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740983040 00000100:00100000:1.0:1790895434.500447:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:1.0:1790895434.500458:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+13:9694:x1877889740983040:12345-192.168.201.54@tcp:37:rm.0 00000100:00100000:1.0:1790895434.507550:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+13:9694:x1877889740983040:12345-192.168.201.54@tcp:37:rm.0 Request processed in 7079us (7292us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895434.507565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:0.0:1790895434.515190:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.518954:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740983296 00000100:00100000:2.0:1790895434.518970:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740983296 00000100:00100000:2.0:1790895434.519045:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:2.0:1790895434.519056:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+13:9694:x1877889740983296:12345-192.168.201.54@tcp:35:rm.0 00000100:00100000:2.0:1790895434.519316:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+14:9694:x1877889740983296:12345-192.168.201.54@tcp:35:rm.0 Request processed in 260us (4134us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790895434.519324:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:2.0:1790895434.523680:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895434.523781:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740983552 00000100:00100000:1.0:1790895434.523794:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740983552 00000100:00100000:1.0:1790895434.523893:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:1.0:1790895434.523904:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+14:9694:x1877889740983552:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:1.0:1790895434.523931:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895434.523951:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf889a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cac expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.524069:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf88a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.524085:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf88a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.524096:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf88a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895434.524109:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790895434.524249:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf889a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cac expref: 17 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.524290:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf88a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cac expref: 16 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.524300:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.524303:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790895434.524306:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c800, rc 0) 00000100:00100000:1.0:1790895434.524362:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:9694:x1877889740983552:12345-192.168.201.54@tcp:101:rm.0 Request processed in 461us (694us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1790895434.524370:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:0.0:1790895434.527842:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.528463:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740983680 00000100:00100000:2.0:1790895434.528475:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740983680 00000100:00100000:2.0:1790895434.528538:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:2.0:1790895434.528549:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+16:9694:x1877889740983680:12345-192.168.201.54@tcp:41:rm.0 00000004:00000024:2.0:1790895434.528627:0:5831:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1790895434.528788:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+16:9694:x1877889740983680:12345-192.168.201.54@tcp:41:rm.0 Request processed in 239us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895434.528813:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:2.0:1790895434.541612:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895434.541708:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740983808 00000100:00100000:1.0:1790895434.541719:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740983808 00000100:00100000:1.0:1790895434.541784:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:1.0:1790895434.541795:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:9694:x1877889740983808:12345-192.168.201.54@tcp:101:rm.0 00010000:00010000:1.0:1790895434.541818:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895434.541839:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cb3 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.541938:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.541952:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.541970:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.541985:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542007:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542014:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542249:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf88c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542259:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf88c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542266:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf88c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895434.542295:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790895434.542300:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895434.542319:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf88c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542331:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf88c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542339:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542346:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542353:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542370:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.542374:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542382:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542395:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.542398:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.542403:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542410:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf88b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542423:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542429:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542436:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542441:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.542444:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542450:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542467:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff8cf314095b00) 00010000:00010000:1.0:1790895434.542469:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.542472:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542477:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf88bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542508:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cb3 expref: 18 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542522:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf88c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cb3 expref: 17 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.542529:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf310c7ef00) 00010000:00010000:1.0:1790895434.542532:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895434.542534:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91da00, rc 0) 00000100:00100000:1.0:1790895434.542648:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:9694:x1877889740983808:12345-192.168.201.54@tcp:101:rm.0 Request processed in 854us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895434.542656:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:0.0:1790895434.554669:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895434.554830:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740984064 00000100:00100000:1.0:1790895434.554842:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740984064 00000100:00100000:1.0:1790895434.554925:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:1.0:1790895434.554935:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+17:9694:x1877889740984064:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:1.0:1790895434.555111:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790895434.555139:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf88c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cb3 expref: 17 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555175:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8870 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c97 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555186:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf310c7ef00) 00010000:00010000:1.0:1790895434.555198:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf8885 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c9e expref: 15 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555205:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.555208:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895434.555226:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555239:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555248:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555260:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555266:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555272:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555391:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555403:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.555408:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790895434.558684:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:1.0:1790895434.558698:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307525839404ns, next at 308525835934ns, rc = 0 00010000:00010000:1.0:1790895434.558765:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558782:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558793:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558801:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558807:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558813:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558829:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895434.558853:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558896:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558910:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558916:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.558920:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558928:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558940:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:1.0:1790895434.558943:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790895434.558948:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558954:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558977:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558982:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558988:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.558992:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91dc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.558994:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.559007:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.559014:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.559015:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.559018:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.559023:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895434.559031:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001fbf7bfa reply state 00000000f3ce41f1 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.559040:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895434.559126:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+16:9694:x1877889740984064:12345-192.168.201.54@tcp:36:rm.0 Request processed in 4189us (4462us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1790895434.559132:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 30 00010000:00010000:0.0:1790895434.559969:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895434.559980:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.559988:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895434.559992:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.560009:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.560023:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:0.0:1790895434.560026:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790895434.560031:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.560037:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf88e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.560070:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895434.560072:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895434.560074:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895434.561780:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.561798:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.561806:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.561812:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895434.561817:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.561824:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.561839:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbcdd3602 (ffff8cf314095300) 00010000:00010000:3.0:1790895434.561853:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895434.561897:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895434.561905:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf88d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbcdd3602 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895434.568069:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895434.568156:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740984320 00000100:00100000:2.0:1790895434.568167:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740984320 00000100:00100000:2.0:1790895434.568212:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:2.0:1790895434.568220:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+15:9694:x1877889740984320:12345-192.168.201.54@tcp:35:rm.0 00000100:00100000:2.0:1790895434.568466:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+16:9694:x1877889740984320:12345-192.168.201.54@tcp:35:rm.0 Request processed in 245us (405us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1790895434.568474:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1790895434.573214:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895434.573497:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740984576 00000100:00100000:1.0:1790895434.573508:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740984576 00000100:00100000:1.0:1790895434.573584:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:1.0:1790895434.573596:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+16:9694:x1877889740984576:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:1.0:1790895434.573654:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1790895434.573682:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf88a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cac expref: 16 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573703:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf883f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c89 expref: 15 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573735:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895434.573754:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8800 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c7b expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573763:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:1.0:1790895434.573770:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895434.573792:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573804:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573814:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573826:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573832:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.573838:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574156:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574166:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574183:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895434.574736:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790895434.574755:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574763:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574770:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574776:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.574780:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574787:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574797:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:1.0:1790895434.574800:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1790895434.574804:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574810:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c200/0x7911a98710cf88f5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574831:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574837:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574849:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574854:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91dc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895434.574892:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574899:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574906:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf314095b00) 00010000:00010000:1.0:1790895434.574909:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895434.574912:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895434.574918:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf88e7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895434.574930:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c6f1708 reply state 0000000010242ab5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895434.574937:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895434.575008:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+15:9694:x1877889740984576:12345-192.168.201.54@tcp:36:rm.0 Request processed in 1413us (1803us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790895434.575017:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 31 00010000:00010000:0.0:1790895434.579646:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.579665:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.579672:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.579685:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895434.579690:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.579697:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.579726:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8cf314095700) 00010000:00010000:0.0:1790895434.579729:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895434.579734:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895434.579740:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf88ee lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895435.486626:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895436.507887:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895436.682730:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895436.682770:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895436.682809:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895436.682834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895436.682934:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740984832 00000100:00100000:3.0:1790895436.682945:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740984832 00000100:00100000:3.0:1790895436.683011:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985088 00000100:00100000:3.0:1790895436.683015:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985088 00000100:00100000:3.0:1790895436.683050:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 93 00000100:00100000:3.0:1790895436.683060:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+14:2361:x1877889740984832:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895436.683136:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+14:2361:x1877889740984832:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 78us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895436.683144:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 93 00000100:00100000:3.0:1790895436.683162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 94 00000100:00100000:3.0:1790895436.683169:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740985088:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895436.683195:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740985088:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895436.683201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 94 00000100:00100000:2.0:1790895436.683473:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740984704 00000100:00100000:2.0:1790895436.683479:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740984704 00000100:00100000:2.0:1790895436.683509:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 246 00000100:00100000:2.0:1790895436.683517:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740984704:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895436.683558:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740984704:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 42us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895436.683565:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 246 00000100:00100000:2.0:1790895436.683599:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740984960 00000100:00100000:2.0:1790895436.683604:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740984960 00000100:00100000:2.0:1790895436.683636:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:2.0:1790895436.683643:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740984960:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895436.683673:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740984960:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 30us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895436.683679:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00080000:0.0:1790895436.683826:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895436.683833:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895437.529525:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790895438.296764:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 311263902330ns, next at 312263899798ns, rc = 0 00000100:00100000:2.0:1790895438.296957:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758841088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895438.297052:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895438.297106:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758841600:0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.297128:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895438.297150:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1790895438.297155:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758841216:0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.297177:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895438.297491:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758841728:0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.297531:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895438.297562:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758841472:0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.297583:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895438.297602:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1790895438.297608:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758841344:0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.297630:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895438.297646:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758841856:0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.297667:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895438.297695:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841088 00000100:00100000:2.0:1790895438.297703:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841088 00000100:00100000:2.0:1790895438.297759:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790895438.297768:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758841088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895438.297803:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895438.297844:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758841088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895438.297851:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1790895438.298938:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841600 00000100:00100000:2.0:1790895438.298950:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841600 00000100:00100000:2.0:1790895438.299000:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841856 00000100:00100000:2.0:1790895438.299015:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841856 00000100:00100000:2.0:1790895438.299049:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790895438.299058:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758841600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.299112:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758841600:12345-0@lo:400:kworker.0 Request processed in 56us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895438.299119:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1790895438.299133:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790895438.299140:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758841856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.299172:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758841856:12345-0@lo:400:kworker.0 Request processed in 33us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895438.299371:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790895438.299402:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841216 00000100:00100000:2.0:1790895438.299407:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841216 00000100:00100000:2.0:1790895438.299431:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1790895438.299438:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758841216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.299471:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758841216:12345-0@lo:400:kworker.0 Request processed in 34us (2293us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895438.299477:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1790895438.299523:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841728 00000100:00100000:2.0:1790895438.299529:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841728 00000100:00100000:2.0:1790895438.299559:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841472 00000100:00100000:2.0:1790895438.299563:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841472 00000100:00100000:2.0:1790895438.299578:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841344 00000100:00100000:2.0:1790895438.299581:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841344 00000100:00100000:2.0:1790895438.299595:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790895438.299601:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758841728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.299634:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758841728:12345-0@lo:400:kworker.0 Request processed in 33us (2102us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895438.299648:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1790895438.299659:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790895438.299665:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758841472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.299696:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758841472:12345-0@lo:400:kworker.0 Request processed in 31us (2111us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895438.299701:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1790895438.299713:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1790895438.299718:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758841344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.299745:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758841344:12345-0@lo:400:kworker.0 Request processed in 27us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895438.299750:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1790895438.299780:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790895438.299785:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895438.299787:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895438.299840:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758841344:0@lo:400:kworker.0 00010000:00080000:2.0:1790895438.299881:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf2018aea00 x1877889758841856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895438.299892:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758841856:0@lo:400:kworker.0 00000100:00100000:2.0:1790895438.299903:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758841472:0@lo:400:kworker.0 00000100:00100000:3.0:1790895438.302116:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758841216:0@lo:400:kworker.0 00000100:00100000:3.0:1790895438.302139:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758841728:0@lo:400:kworker.0 00010000:00080000:3.0:1790895438.302154:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf340687480 x1877889758841088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895438.302173:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758841088:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1790895438.302212:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3060c2680 x1877889758841600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895438.302220:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758841600:0@lo:400:kworker.0 00010000:00010000:1.0:1790895438.557089:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895438.809114:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895438.809146:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758841984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790895438.809215:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895438.809266:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758841984 00000100:00100000:3.0:1790895438.809275:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758841984 00000100:00100000:3.0:1790895438.809340:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790895438.809354:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758841984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895438.809401:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895438.809463:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758841984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895438.809470:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1790895438.809582:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc24000 x1877889758841984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895438.809603:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758841984:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1790895438.810825:0:11618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1790895439.401192:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00000004:00080000:1.0:1790895439.401216:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000001:00080000:1.0:1790895439.401227:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1790895439.401232:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1790895439.401527:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758842112:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1790895439.401604:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895439.401821:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758842112 00000100:00100000:2.0:1790895439.401830:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758842112 00000100:00100000:2.0:1790895439.402190:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790895439.402201:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758842112:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1790895439.402240:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1790895439.402274:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6abee54a, atime: 0x6abee54a, ctime: 0x6abee54a, blocks: 0x1 00010000:00010000:2.0:1790895439.402283:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.402301:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=312s v=(0 0) 00010000:00010000:2.0:1790895439.402305:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895439.402312:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.402331:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.402342:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.402349:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.402369:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790895439.403181:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758842112:12345-0@lo:6:osp-syn-0-0.0 Request processed in 980us (1575us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1790895439.403191:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1790895439.403282:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895439.403291:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.403303:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ea00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895439.403307:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.403317:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.403337:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.403345:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf88fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.403362:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895439.403369:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895439.403371:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790895439.403784:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf2018aea00/2, rc 0, transno 4294967300 00000100:00100000:3.0:1790895439.403793:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758842112:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1790895439.579207:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1790895439.780264:0:11666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcd65ef2a0 20000000:00000080:1.0:1790895439.780286:0:11666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf33fa16000 uarg=0000000000000000 20000000:01000000:1.0:1790895439.780323:0:11666:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790895439.780328:0:11666:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1790895439.780333:0:11666:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1790895439.781392:0:11667:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1790895439.781650:0:11666:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1790895439.788624:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1790895439.788679:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1790895439.788747:0:11666:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1790895439.788776:0:11666:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1790895439.788796:0:11666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788825:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf879e expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788833:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf87ac expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788840:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf87ba expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788850:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788886:0:11666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788893:0:11666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788932:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.788958:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 12 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.789212:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842240:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895439.789356:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.789377:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.789385:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842368:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895439.789431:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf87ba expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.789439:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf87ba expref: 18 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.789449:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842496:0@lo:104: 00000100:00100000:2.0:1790895439.789498:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790895439.789547:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf87ac expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.789555:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf87ac expref: 18 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.789562:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842624:0@lo:104: 00000100:00100000:2.0:1790895439.789583:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1790895439.789608:0:11666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf879e expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895439.789615:0:11666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf879e expref: 18 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.789623:0:11666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842752:0@lo:104: 00000100:00100000:2.0:1790895439.789646:0:11666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895439.789668:0:11666:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b900 going to sleep for 11 seconds 00000100:00100000:0.0:1790895439.790213:0:7629:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1790895439.790228:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758842496 00000100:00100000:0.0:1790895439.790235:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758842496 00000100:00100000:0.0:1790895439.790273:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758842624 00000100:00100000:0.0:1790895439.790276:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758842624 00000100:00100000:0.0:1790895439.790285:0:7629:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758842752 00000100:00100000:0.0:1790895439.790287:0:7629:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758842752 00000100:00100000:0.0:1790895439.790299:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790895439.790307:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+5:11666:x1877889758842496:12345-0@lo:104: 00010000:00010000:0.0:1790895439.790321:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790387:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790895439.790393:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077ab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+5:11666:x1877889758842496:12345-0@lo:104: Request processed in 87us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895439.790417:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1790895439.790434:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790895439.790440:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+4:11666:x1877889758842624:12345-0@lo:104: 00010000:00010000:0.0:1790895439.790447:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790492:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1790895439.790497:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+4:11666:x1877889758842624:12345-0@lo:104: Request processed in 58us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895439.790503:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790895439.790515:0:7629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1790895439.790520:0:7629:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308e03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+3:11666:x1877889758842752:12345-0@lo:104: 00010000:00010000:0.0:1790895439.790527:0:7629:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790558:0:7629:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1790895439.790563:0:7629:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308e03450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:221ad158-1cb7-4652-832e-1e3667184cca+3:11666:x1877889758842752:12345-0@lo:104: Request processed in 43us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895439.790568:0:7629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1790895439.790607:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790895439.790613:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790620:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ee00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895439.790624:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790644:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895439.790651:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895439.790656:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790895439.790690:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790696:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790895439.790732:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790741:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ee00/0x7911a98710cf87ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87c1 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790755:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790895439.790758:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790763:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84fa00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895439.790766:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790773:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895439.790780:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895439.790791:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790895439.790817:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790823:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790895439.790840:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790847:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fa00/0x7911a98710cf87ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87b3 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790889:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895439.790893:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790899:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f600 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895439.790902:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790908:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895439.790914:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895439.790919:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1790895439.790931:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790936:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790895439.790948:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.790954:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf879e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf87a5 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.791096:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895439.791098:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895439.791100:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895439.791108:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895439.791114:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895439.791137:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758842880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895439.791175:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895439.791233:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758843008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895439.791254:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895439.791270:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895439.791276:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758843136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895439.791298:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895439.791326:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758842880 00000100:00100000:0.0:1790895439.791331:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758842880 00010000:00010000:0.0:1790895439.791352:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf87ba expref: 19 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895439.791370:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843008 00000100:00100000:0.0:1790895439.791373:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843008 00010000:00010000:0.0:1790895439.791382:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf87ac expref: 20 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895439.791392:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843136 00000100:00100000:0.0:1790895439.791394:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843136 00010000:00010000:0.0:1790895439.791413:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf879e expref: 21 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895439.791426:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790895439.791432:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+21:3311:x1877889758842880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895439.791442:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895439.791447:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf87ba expref: 21 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.791456:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf87ba expref: 21 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.791470:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895439.791513:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+21:3311:x1877889758842880:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895439.791519:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790895439.791532:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790895439.791538:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+20:3308:x1877889758843008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895439.791545:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895439.791549:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf87ac expref: 20 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.791556:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf87ac expref: 20 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.791564:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895439.791589:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+20:3308:x1877889758843008:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895439.791595:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1790895439.791613:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790895439.791619:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306506050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758843136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895439.791626:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895439.791630:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf879e expref: 19 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.791637:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf879e expref: 19 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895439.791647:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895439.791668:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306506050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758843136:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895439.791674:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790895439.791731:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758843136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895439.791740:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758843008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895439.791762:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758842880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790895439.792270:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f91d200/0x7911a98710cf87c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf87ba expref: 18 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.792284:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842496:0@lo:104: 00010000:00010000:2.0:1790895439.792295:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf87b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf87ac expref: 17 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.792304:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077abb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842624:0@lo:104: 00010000:00010000:2.0:1790895439.792313:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf87a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf879e expref: 16 pid: 5824 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895439.792323:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842752:0@lo:104: 00000100:00100000:0.0:1790895439.797225:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895439.797252:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895439.799145:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842240:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895439.799163:0:11666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11666:1877889758842368:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895439.799200:0:11666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895439.799618:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985344 00000100:00100000:1.0:1790895439.799628:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985344 00010000:00010000:1.0:1790895439.799669:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 13 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895439.799710:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985216 00000100:00100000:1.0:1790895439.799783:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985216 00010000:00010000:1.0:1790895439.799802:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 14 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895439.799915:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:1.0:1790895439.799925:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+14:2361:x1877889740985344:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895439.799940:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895439.799946:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 14 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.799970:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 14 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.799987:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf3029ca000/0x7911a98710cf87cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c6d expref: 14 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800016:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895439.800076:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740985344:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 152us (2862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895439.800083:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:1.0:1790895439.800100:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:1.0:1790895439.800106:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+12:2361:x1877889740985216:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895439.800114:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895439.800118:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800129:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800139:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf87c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c66 expref: 12 pid: 5826 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800150:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800159:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800173:0:5816:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800181:0:5816:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800197:0:5816:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800204:0:5816:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800210:0:5816:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895439.800214:0:5816:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800222:0:5816:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800237:0:5816:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895439.800245:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895439.800265:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+11:2361:x1877889740985216:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 159us (3013us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895439.800272:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 34 00010000:00010000:3.0:1790895439.800528:0:11666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895439.800538:0:11666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895439.800555:0:11666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84e800/0x7911a98710cf8903 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895439.888045:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1790895440.600117:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895441.417088:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895441.417279:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985472 00000100:00100000:3.0:1790895441.417291:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985472 00000100:00100000:3.0:1790895441.417356:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 248 00000100:00100000:3.0:1790895441.417368:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+11:5602:x1877889740985472:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895441.417386:0:5824:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895441.417406:0:5824:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf3029cb600/0x7911a98710cf890a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cba expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.417434:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf3029cb600/0x7911a98710cf890a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cba expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.417445:0:5824:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf3029cb600/0x7911a98710cf890a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cba expref: 12 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.417466:0:5824:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029cb600, rc 0) 00000100:00100000:3.0:1790895441.417527:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740985472:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 162us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895441.417535:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 248 00000100:00100000:0.0:1790895441.425759:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895441.425849:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985600 00000100:00100000:2.0:1790895441.425882:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985600 00000100:00100000:2.0:1790895441.425947:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 249 00000100:00100000:2.0:1790895441.425958:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740985600:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895441.426588:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305977c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740985600:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 629us (836us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.426596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 249 00000100:00100000:0.0:1790895441.432169:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895441.432271:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985728 00000100:00100000:2.0:1790895441.432282:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985728 00000100:00100000:2.0:1790895441.432338:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 250 00000100:00100000:2.0:1790895441.432346:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740985728:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895441.432781:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305976450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740985728:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 434us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.432800:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 250 00000100:00100000:0.0:1790895441.437933:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895441.438461:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985856 00000100:00100000:3.0:1790895441.438472:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985856 00000100:00100000:3.0:1790895441.438575:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 251 00000100:00100000:3.0:1790895441.438587:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+12:9964:x1877889740985856:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790895441.438905:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+12:9964:x1877889740985856:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 319us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895441.438919:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 251 00000100:00100000:0.0:1790895441.444634:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895441.444893:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740985984 00000100:00100000:2.0:1790895441.444904:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740985984 00000100:00100000:2.0:1790895441.445058:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 252 00000100:00100000:2.0:1790895441.445070:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:9964:x1877889740985984:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790895441.445493:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305974850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:9964:x1877889740985984:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 424us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.445502:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 252 00000100:00100000:3.0:1790895441.448554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895441.448643:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740986112 00000100:00100000:2.0:1790895441.448653:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740986112 00000100:00100000:2.0:1790895441.448726:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 253 00000100:00100000:2.0:1790895441.448736:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+12:5602:x1877889740986112:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895441.448754:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895441.448773:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf8911 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cc1 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895441.448801:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf8911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cc1 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895441.448813:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf8911 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cc1 expref: 13 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895441.448822:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fc00, rc 0) 00000100:00100000:2.0:1790895441.451360:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740986112:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 2611us (2802us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.451375:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 253 00000100:00100000:3.0:1790895441.453677:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895441.454359:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740986240 00000100:00100000:1.0:1790895441.454369:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740986240 00000100:00100000:1.0:1790895441.454479:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 254 00000100:00100000:1.0:1790895441.454491:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740986240:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895441.455584:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf305975050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740986240:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 1088us (1909us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895441.455595:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 254 00000100:00100000:3.0:1790895441.461338:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895441.461512:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740986368 00000100:00100000:2.0:1790895441.461526:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740986368 00000100:00100000:2.0:1790895441.461589:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 255 00000100:00100000:2.0:1790895441.461599:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740986368:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895441.461847:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:5602:x1877889740986368:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 248us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.461855:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 255 00000100:00100000:3.0:1790895441.468678:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895441.468898:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740986496 00000100:00100000:0.0:1790895441.468909:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740986496 00000100:00100000:0.0:1790895441.468962:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 256 00000100:00100000:0.0:1790895441.468987:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:9966:x1877889740986496:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790895441.469642:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:9966:x1877889740986496:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 655us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895441.469652:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 256 00000100:00100000:3.0:1790895441.485350:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895441.485549:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740986624 00000100:00100000:0.0:1790895441.485561:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740986624 00000100:00100000:0.0:1790895441.485621:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 257 00000100:00100000:0.0:1790895441.485632:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:9966:x1877889740986624:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790895441.485933:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:9966:x1877889740986624:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 302us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895441.485951:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 257 00010000:00010000:0.0:1790895441.629028:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1790895441.688151:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1790895441.688159:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf332953800 from 7 10000000:01000000:0.0:1790895441.688164:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790895441.688213:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895441.688226:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895441.688248:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895441.688275:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790895441.688340:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895441.688403:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3060efc00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895441.690009:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843264 00000100:00100000:1.0:1790895441.690034:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843264 00000100:00100000:1.0:1790895441.690108:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1790895441.690120:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+16:5828:x1877889758843264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895441.690146:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895441.690163:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f91c200/0x7911a98710cf891f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8918 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895441.690191:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f91c200/0x7911a98710cf891f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8918 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895441.690202:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f91c200/0x7911a98710cf891f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8918 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895441.690210:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c200, rc 0) 00000100:00100000:1.0:1790895441.690281:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758843264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895441.690287:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1790895441.690469:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895441.690487:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.690496:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895441.690565:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.690600:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.690644:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:2.0:1790895441.691238:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843392 00000100:00100000:2.0:1790895441.691245:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843392 00000100:00100000:2.0:1790895441.691285:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1790895441.691293:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758843392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895441.691579:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758843392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.691588:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1790895441.691679:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.691714:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.691752:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.691791:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:0.0:1790895441.691905:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843520 00000100:00100000:0.0:1790895441.691911:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843520 00000100:00100000:0.0:1790895441.691944:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1790895441.691953:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758843520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895441.692128:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758843520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895441.692135:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1790895441.692560:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895441.693533:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11680:1877889758843648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895441.693589:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895441.693629:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b600 going to sleep for 11 seconds 00000100:00100000:1.0:1790895441.693695:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843648 00000100:00100000:1.0:1790895441.693701:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843648 00000100:00100000:1.0:1790895441.693740:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1790895441.693748:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:11680:x1877889758843648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895441.696259:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+17:11680:x1877889758843648:12345-0@lo:502:llog_process_th.0 Request processed in 2503us (2661us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895441.696275:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1790895441.707685:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11680:1877889758843648:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790895441.707738:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895441.707748:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895441.707758:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790895441.707764:0:11680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf332953800 00000020:00000080:3.0:1790895441.707766:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790895441.707887:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11680:1877889758843776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895441.708048:0:11680:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895441.708107:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:3.0:1790895441.708243:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843776 00000100:00100000:3.0:1790895441.708250:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843776 00000100:00100000:3.0:1790895441.708304:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1790895441.708313:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:11680:x1877889758843776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.709074:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+17:11680:x1877889758843776:12345-0@lo:502:llog_process_th.0 Request processed in 761us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895441.709082:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1790895441.716153:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11680:1877889758843776:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790895441.716203:0:11680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895441.716212:0:11680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895441.716214:0:11680:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1790895441.716219:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790895441.716432:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790895441.716463:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790895441.716474:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.716485:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895441.716494:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790895441.716497:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf310bbd000 from 7 10000000:01000000:3.0:1790895441.716499:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790895441.716533:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.716541:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.716550:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895441.716580:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.716639:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.716684:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098e40 going to sleep for 11 seconds 00000100:00100000:2.0:1790895441.716790:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758843904 00000100:00100000:2.0:1790895441.716796:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758843904 00000100:00100000:2.0:1790895441.716836:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1790895441.716850:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+17:5828:x1877889758843904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895441.717454:0:5825:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895441.717470:0:5825:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf892d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8926 expref: -99 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895441.717495:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf892d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8926 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895441.717505:0:5825:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf892d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8926 expref: 18 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895441.717513:0:5825:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f000, rc 0) 00000100:00100000:2.0:1790895441.717556:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758843904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 707us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.717564:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1790895441.718095:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758843904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895441.718112:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.718122:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895441.718178:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.718207:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.718243:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895441.722316:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844032 00000100:00100000:1.0:1790895441.722334:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844032 00000100:00100000:1.0:1790895441.722405:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1790895441.722417:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758844032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895441.722845:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758844032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (4635us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895441.722853:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1790895441.722994:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.723043:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.723087:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.723126:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895441.724891:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844160 00000100:00100000:1.0:1790895441.724903:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844160 00000100:00100000:1.0:1790895441.725331:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1790895441.725344:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758844160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895441.725585:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303161850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758844160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (2497us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895441.725593:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1790895441.726612:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.734000:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11681:1877889758844288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.734082:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.734125:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844288 00000100:00100000:3.0:1790895441.734133:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844288 00000100:00100000:3.0:1790895441.734176:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790895441.734186:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:11681:x1877889758844288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.734402:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+18:11681:x1877889758844288:12345-0@lo:502:llog_process_th.0 Request processed in 217us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895441.734410:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1790895441.734476:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:3.0:1790895441.734497:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11681:1877889758844288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790895441.734526:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895441.734534:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895441.734537:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790895441.734543:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf310bbd000 00000020:00000080:3.0:1790895441.734545:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790895441.734611:0:11681:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11681:1877889758844416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.734644:0:11681:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.734666:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844416 00000100:00100000:3.0:1790895441.734669:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844416 00000100:00100000:3.0:1790895441.734708:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790895441.734715:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:11681:x1877889758844416:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.734820:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:11681:x1877889758844416:12345-0@lo:502:llog_process_th.0 Request processed in 105us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895441.734826:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1790895441.734853:0:11681:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:3.0:1790895441.734886:0:11681:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11681:1877889758844416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790895441.734903:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895441.734908:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895441.734909:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790895441.734913:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1790895441.734963:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1790895441.734991:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790895441.735000:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.735012:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895441.735022:0:5828:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790895441.735025:0:5828:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf303072000 from 7 10000000:01000000:3.0:1790895441.735028:0:5828:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790895441.735051:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.735060:0:5828:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.735068:0:5828:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895441.735082:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.735108:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.735121:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:3.0:1790895441.735132:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844544 00000100:00100000:3.0:1790895441.735135:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844544 00000100:00100000:3.0:1790895441.735156:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790895441.735162:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+18:5828:x1877889758844544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895441.735171:0:5826:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895441.735183:0:5826:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf893b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf8934 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.735214:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf893b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf8934 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.735224:0:5826:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf893b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf8934 expref: 19 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.735233:0:5826:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029cb400, rc 0) 00000100:00100000:3.0:1790895441.735262:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303163850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758844544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895441.735268:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1790895441.735295:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895441.735306:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895441.735313:0:5828:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895441.735351:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.735375:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.735399:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:2.0:1790895441.735465:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844672 00000100:00100000:2.0:1790895441.735470:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844672 00000100:00100000:2.0:1790895441.735497:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1790895441.735504:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758844672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895441.736385:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303160450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758844672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 878us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.736395:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1790895441.736642:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.736681:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895441.736734:0:5828:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.736768:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098240 going to sleep for 11 seconds 00000100:00100000:2.0:1790895441.737073:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844800 00000100:00100000:2.0:1790895441.737079:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844800 00000100:00100000:2.0:1790895441.737241:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1790895441.737252:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758844800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895441.737408:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303162c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:5828:x1877889758844800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.737422:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1790895441.739190:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:221ad158-1cb7-4652-832e-1e3667184cca:5828:1877889758844800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790895441.749895:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1790895441.755491:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11684:1877889758844928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.755582:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.755622:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895441.755800:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758844928 00000100:00100000:2.0:1790895441.755808:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758844928 00000100:00100000:2.0:1790895441.755880:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1790895441.755891:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:11684:x1877889758844928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895441.756129:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:11684:x1877889758844928:12345-0@lo:502:llog_process_th.0 Request processed in 240us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.756138:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1790895441.756434:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11684:1877889758844928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790895441.756474:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895441.756483:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895441.756486:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790895441.756492:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf303072000 00000020:00000080:3.0:1790895441.756495:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1790895441.756578:0:11684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11684:1877889758845056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.756609:0:11684:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895441.756631:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845056 00000100:00100000:3.0:1790895441.756634:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845056 00000100:00100000:3.0:1790895441.756653:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790895441.756659:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:11684:x1877889758845056:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895441.756773:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:11684:x1877889758845056:12345-0@lo:502:llog_process_th.0 Request processed in 113us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895441.756780:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1790895441.756804:0:11684:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895441.756814:0:11684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:221ad158-1cb7-4652-832e-1e3667184cca:11684:1877889758845056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1790895441.756828:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895441.756832:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895441.756833:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790895441.756837:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1790895441.770068:0:5828:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1790895441.770107:0:5828:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1790895441.770119:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895441.770132:0:5828:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895441.803789:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895441.803832:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895441.803883:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895441.803911:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740986752 00000100:00100000:2.0:1790895441.803924:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740986752 00000100:00100000:2.0:1790895441.804009:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987008 00000100:00100000:2.0:1790895441.804013:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987008 00000100:00100000:2.0:1790895441.804038:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 98 00000100:00100000:2.0:1790895441.804048:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740986752:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895441.804334:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740986752:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 286us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.804342:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 98 00000100:00100000:2.0:1790895441.804362:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 99 00000100:00100000:2.0:1790895441.804369:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740987008:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895441.804395:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740987008:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.804401:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 99 00000100:00100000:2.0:1790895441.804423:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740986880 00000100:00100000:2.0:1790895441.804427:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740986880 00000100:00100000:2.0:1790895441.804470:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:2.0:1790895441.804478:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740986880:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895441.804511:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889740986880:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 34us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895441.804518:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00080000:1.0:1790895441.804678:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790895441.804682:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895442.648096:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790895442.778334:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1790895443.416231:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758845312:0@lo:400:kworker.0 00000100:00100000:0.0:1790895443.416231:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758845184:0@lo:400:kworker.0 00000100:00100000:3.0:1790895443.416336:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758845440:0@lo:400:kworker.0 00000100:00100000:2.0:1790895443.417658:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758845568:0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.428215:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895443.428307:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758845824:0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.428346:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895443.428411:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845312 00000100:00100000:1.0:1790895443.428434:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845312 00000100:00100000:1.0:1790895443.428632:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790895443.428721:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758845312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.428777:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758845312:12345-0@lo:400:kworker.0 Request processed in 59us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895443.428784:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1790895443.429156:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758845312:0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.429203:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845824 00000100:00100000:1.0:1790895443.429208:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845824 00000100:00100000:1.0:1790895443.429252:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1790895443.429259:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758845824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.429294:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758845824:12345-0@lo:400:kworker.0 Request processed in 36us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895443.429300:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:1.0:1790895443.429315:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1790895443.429336:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3077ab480 x1877889758845824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895443.429349:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758845824:0@lo:400:kworker.0 00000100:00100000:0.0:1790895443.430240:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895443.430285:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758845696:0@lo:400:kworker.0 00000100:00100000:0.0:1790895443.430318:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895443.430369:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845696 00000100:00100000:0.0:1790895443.430374:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845696 00000100:00100000:0.0:1790895443.430412:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1790895443.430432:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758845696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895443.430489:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758845696:12345-0@lo:400:kworker.0 Request processed in 58us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895443.430496:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1790895443.430519:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895443.430540:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758845696:0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.430724:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845184 00000100:00100000:1.0:1790895443.430821:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845184 00000100:00100000:1.0:1790895443.433737:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1790895443.433763:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758845184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.433910:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758845184:12345-0@lo:400:kworker.0 Request processed in 160us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895443.433918:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1790895443.434023:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758845184:0@lo:400:kworker.0 00000100:00100000:3.0:1790895443.434222:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895443.434266:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758845952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895443.434312:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895443.434443:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845440 00000100:00100000:1.0:1790895443.434451:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845440 00000100:00100000:1.0:1790895443.434513:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1790895443.434521:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758845440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895443.434571:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758845440:12345-0@lo:400:kworker.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895443.434577:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1790895443.435053:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845952 00000100:00100000:0.0:1790895443.435060:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845952 00000100:00100000:0.0:1790895443.435108:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1790895443.435117:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758845952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895443.435149:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895443.435188:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758845952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895443.435195:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1790895443.436508:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790895443.436517:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895443.436566:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1790895443.436573:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf2018aea00, transno 4294967300 00000100:00100000:3.0:1790895443.436608:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758845952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895443.436624:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758845440:0@lo:400:kworker.0 00000100:00100000:2.0:1790895443.441708:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895443.441914:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758845568 00000100:00100000:0.0:1790895443.441925:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758845568 00000100:00100000:0.0:1790895443.441984:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790895443.441995:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758845568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895443.442069:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758845568:12345-0@lo:400:kworker.0 Request processed in 75us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895443.442076:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790895443.442244:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758845568:0@lo:400:kworker.0 00010000:00010000:0.0:1790895443.672034:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895443.929846:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895443.929887:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758846080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790895443.929959:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895443.930195:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846080 00000100:00100000:0.0:1790895443.930206:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846080 00000100:00100000:0.0:1790895443.930267:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1790895443.930279:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758846080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895443.930331:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895443.930393:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758846080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895443.930400:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:3.0:1790895443.930519:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc24e00 x1877889758846080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895443.930539:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758846080:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895444.696084:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895445.720489:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895446.744998:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895446.921530:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895446.921574:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895446.921614:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895446.921660:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895446.921709:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987392 00000100:00100000:3.0:1790895446.921720:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987392 00000100:00100000:3.0:1790895446.921790:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:3.0:1790895446.921801:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740987392:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895446.921924:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740987392:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 125us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895446.921931:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00080000:3.0:1790895446.921951:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895446.922110:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987136 00000100:00100000:1.0:1790895446.922115:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987136 00000100:00100000:1.0:1790895446.922155:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 274 00000100:00100000:1.0:1790895446.922163:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889740987136:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895446.922200:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889740987136:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 37us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895446.922207:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 274 00000100:00100000:2.0:1790895446.922437:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987264 00000100:00100000:2.0:1790895446.922442:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987264 00000100:00100000:2.0:1790895446.922485:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987520 00000100:00100000:2.0:1790895446.922489:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987520 00000100:00100000:2.0:1790895446.922509:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 103 00000100:00100000:2.0:1790895446.922517:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740987264:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895446.922554:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2363:x1877889740987264:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 38us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895446.922561:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 103 00000100:00100000:2.0:1790895446.922576:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 104 00000100:00100000:2.0:1790895446.922582:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740987520:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895446.922611:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740987520:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 30us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895446.922618:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 104 00000100:00080000:1.0:1790895446.922683:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895447.768133:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895448.536375:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758846336:0@lo:400:kworker.0 00000100:00100000:2.0:1790895448.536457:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895448.536536:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758846848:0@lo:400:kworker.0 00000100:00100000:2.0:1790895448.536565:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895448.536597:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790895448.536618:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758846208:0@lo:400:kworker.0 00000100:00100000:2.0:1790895448.536643:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895448.536662:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758846720:0@lo:400:kworker.0 00000100:00100000:2.0:1790895448.536684:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895448.536759:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846336 00000100:00100000:1.0:1790895448.536766:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846336 00000100:00100000:1.0:1790895448.536814:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846720 00000100:00100000:1.0:1790895448.536825:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846720 00000100:00100000:1.0:1790895448.536882:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790895448.536892:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758846336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895448.536947:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758846336:12345-0@lo:400:kworker.0 Request processed in 57us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895448.536954:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790895448.536970:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790895448.536976:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758846720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895448.537001:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758846720:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895448.537007:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00080000:1.0:1790895448.537023:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895448.537058:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758846720:0@lo:400:kworker.0 00000100:00100000:1.0:1790895448.537079:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758846336:0@lo:400:kworker.0 00000100:00100000:3.0:1790895448.537459:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758846464:0@lo:400:kworker.0 00000100:00100000:3.0:1790895448.537500:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895448.537529:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895448.537536:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758846592:0@lo:400:kworker.0 00000100:00100000:3.0:1790895448.537560:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895448.537593:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846848 00000100:00100000:3.0:1790895448.537598:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846848 00000100:00100000:3.0:1790895448.537648:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846592 00000100:00100000:3.0:1790895448.537651:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846592 00000100:00100000:3.0:1790895448.537675:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790895448.537682:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758846848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895448.537724:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758846848:12345-0@lo:400:kworker.0 Request processed in 42us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895448.537731:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790895448.537743:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1790895448.537749:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758846592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895448.537778:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758846592:12345-0@lo:400:kworker.0 Request processed in 29us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895448.537784:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1790895448.537801:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790895448.537804:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1790895448.537965:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf336be5f80 x1877889758846848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895464 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895448.537977:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758846848:0@lo:400:kworker.0 00000100:00100000:2.0:1790895448.537999:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895448.538007:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758846976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895448.538035:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895448.538160:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758846592:0@lo:400:kworker.0 00000100:00100000:1.0:1790895448.538372:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846464 00000100:00100000:1.0:1790895448.538378:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846464 00000100:00100000:1.0:1790895448.538425:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790895448.538433:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758846464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895448.538470:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758846464:12345-0@lo:400:kworker.0 Request processed in 39us (970us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895448.538477:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1790895448.538611:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895448.538643:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758846464:0@lo:400:kworker.0 00000100:00100000:0.0:1790895448.538779:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846208 00000100:00100000:0.0:1790895448.538785:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846208 00000100:00100000:0.0:1790895448.538838:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1790895448.538847:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758846208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895448.538915:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758846208:12345-0@lo:400:kworker.0 Request processed in 70us (2270us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895448.538921:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1790895448.538947:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758846976 00000100:00100000:0.0:1790895448.538951:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758846976 00000100:00100000:0.0:1790895448.538985:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790895448.538992:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758846976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895448.539015:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895448.539051:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758846976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895448.539057:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790895448.539091:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758846976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895448.539223:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758846208:0@lo:400:kworker.0 00010000:00010000:0.0:1790895448.792169:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895449.048115:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895449.048145:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758847104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895449.048213:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895449.048529:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758847104 00000100:00100000:0.0:1790895449.048540:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758847104 00000100:00100000:0.0:1790895449.048604:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790895449.048614:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758847104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895449.048655:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895449.048727:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758847104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895449.048734:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1790895449.048997:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc27b80 x1877889758847104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895449.049020:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc27b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758847104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895449.817882:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895450.840097:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895451.864243:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895452.041977:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895452.042028:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895452.042061:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895452.042104:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895452.042133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987776 00000100:00100000:3.0:1790895452.042144:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987776 00000100:00100000:3.0:1790895452.042208:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988032 00000100:00100000:3.0:1790895452.042212:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988032 00000100:00100000:3.0:1790895452.042232:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 108 00000100:00100000:3.0:1790895452.042242:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740987776:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895452.042325:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740987776:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895452.042333:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 108 00000100:00100000:3.0:1790895452.042349:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 109 00000100:00100000:3.0:1790895452.042356:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740988032:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895452.042380:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740988032:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 25us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895452.042387:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 109 00000100:00080000:3.0:1790895452.042413:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895452.042598:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987648 00000100:00100000:0.0:1790895452.042603:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987648 00000100:00100000:0.0:1790895452.042636:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 276 00000100:00100000:0.0:1790895452.042644:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740987648:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895452.042679:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740987648:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 36us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895452.042686:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 276 00000100:00100000:2.0:1790895452.043342:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740987904 00000100:00100000:2.0:1790895452.043350:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740987904 00000100:00100000:2.0:1790895452.043414:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:2.0:1790895452.043424:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740987904:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895452.043468:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740987904:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 46us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895452.043475:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00080000:0.0:1790895452.043563:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790895452.896747:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895453.016599:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790895453.656131:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758847360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895453.656160:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758847232:0@lo:400:kworker.0 00000100:00100000:2.0:1790895453.659263:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758847488:0@lo:400:kworker.0 00000100:00100000:1.0:1790895453.664342:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895453.664846:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790895453.664943:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758847744:0@lo:400:kworker.0 00000100:00100000:3.0:1790895453.665145:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758847616:0@lo:400:kworker.0 00000100:00100000:0.0:1790895453.676177:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895453.676254:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790895453.676270:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758847872:0@lo:400:kworker.0 00000100:00100000:0.0:1790895453.676331:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895453.676375:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758847360 00000100:00100000:0.0:1790895453.676383:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758847360 00000100:00100000:0.0:1790895453.676441:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790895453.676450:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758847360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895453.676502:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895453.676549:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758847360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895453.676556:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1790895453.676590:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895453.676596:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895453.676631:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30748dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758848000:0@lo:400:kworker.0 00000100:00100000:3.0:1790895453.676660:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895453.676671:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895453.676709:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848000 00000100:00100000:2.0:1790895453.676721:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848000 00000100:00100000:2.0:1790895453.676756:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790895453.676764:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758848000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895453.676804:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758848000:12345-0@lo:400:kworker.0 Request processed in 40us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895453.676809:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:2.0:1790895453.676843:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30748dc00 x1877889758848000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895469 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895453.676873:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30748dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758848000:0@lo:400:kworker.0 00000100:00100000:0.0:1790895453.680678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758847872 00000100:00100000:0.0:1790895453.680696:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758847872 00000100:00100000:0.0:1790895453.681012:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758847488 00000100:00100000:0.0:1790895453.681017:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758847488 00000100:00100000:0.0:1790895453.681051:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790895453.681061:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758847872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895453.681371:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758847872:12345-0@lo:400:kworker.0 Request processed in 310us (5038us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895453.681379:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1790895453.682990:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758847616 00000100:00100000:0.0:1790895453.683004:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758847616 00000100:00100000:1.0:1790895453.683027:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895453.683050:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1790895453.683062:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758847488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895453.683130:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758847488:12345-0@lo:400:kworker.0 Request processed in 71us (6537us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895453.683136:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790895453.683146:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758847232 00000100:00100000:1.0:1790895453.683153:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758847232 00000100:00100000:0.0:1790895453.683157:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1790895453.683166:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758847616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895453.683190:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790895453.683203:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758847232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895453.683210:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758847616:12345-0@lo:400:kworker.0 Request processed in 44us (6548us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895453.683218:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1790895453.683294:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758847872:0@lo:400:kworker.0 00000100:00100000:0.0:1790895453.685718:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758847616:0@lo:400:kworker.0 00000100:00080000:0.0:1790895453.685799:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790895453.685806:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895453.686992:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758847232:12345-0@lo:400:kworker.0 Request processed in 3788us (22651us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895453.687004:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1790895453.687069:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758847744 00000100:00100000:2.0:1790895453.688028:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758847232:0@lo:400:kworker.0 00000100:00100000:1.0:1790895453.691317:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758847744 00000100:00100000:1.0:1790895453.691431:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790895453.691442:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758847744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895453.691546:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758847744:12345-0@lo:400:kworker.0 Request processed in 106us (8522us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895453.691554:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1790895453.691623:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758847744:0@lo:400:kworker.0 00000100:00100000:3.0:1790895453.692108:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758847360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895453.702455:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758847488:0@lo:400:kworker.0 00010000:00010000:0.0:1790895453.912149:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895454.169426:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758848128:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895454.169508:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895454.169977:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848128 00000100:00100000:0.0:1790895454.169986:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848128 00000100:00100000:0.0:1790895454.170043:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1790895454.170054:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758848128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895454.170092:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895454.170148:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758848128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895454.170156:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1790895454.170241:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf30fc24380 x1877889758848128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895454.170260:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758848128:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895454.937499:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895455.960479:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895456.985447:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895457.165572:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895457.165622:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895457.165894:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988288 00000100:00100000:1.0:1790895457.165905:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988288 00000100:00100000:1.0:1790895457.165989:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:1.0:1790895457.166001:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740988288:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895457.166091:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740988288:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 93us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895457.166099:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:0.0:1790895457.166306:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988160 00000100:00100000:0.0:1790895457.166311:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988160 00000100:00100000:0.0:1790895457.166347:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 278 00000100:00100000:0.0:1790895457.166355:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740988160:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895457.166390:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740988160:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 36us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895457.166397:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 278 00000100:00080000:2.0:1790895457.166554:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895457.177958:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895457.178058:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895457.183301:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988416 00000100:00100000:2.0:1790895457.183319:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988416 00000100:00100000:2.0:1790895457.183429:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:2.0:1790895457.183442:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2360:x1877889740988416:12345-192.168.201.54@tcp:9:kworker.0 00000020:00000080:2.0:1790895457.183475:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8877 00000100:00080000:2.0:1790895457.183486:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf3368a6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1790895457.183528:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1790895457.183813:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+2:2360:x1877889740988416:12345-192.168.201.54@tcp:9:kworker.0 Request processed in 373us (5753us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895457.183821:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00010000:00010000:2.0:1790895457.183843:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1790895457.186525:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895457.186623:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988544 00000100:00100000:0.0:1790895457.186637:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988544 00000100:00100000:0.0:1790895457.186784:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:0.0:1790895457.186795:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740988544:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895457.186917:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889740988544:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 123us (8968us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895457.186925:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00080000:3.0:1790895457.194659:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895458.008151:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895458.776210:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758848512:0@lo:400:kworker.0 00000100:00100000:0.0:1790895458.776283:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895458.776355:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895458.776362:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758848640:0@lo:400:kworker.0 00000100:00100000:0.0:1790895458.776389:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895458.776494:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758848256:0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.776532:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895458.776576:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758848768:0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.776600:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895458.776630:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1790895458.776637:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758848384:0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.776660:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895458.776677:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758848896:0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.776699:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895458.776725:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848512 00000100:00100000:3.0:1790895458.776733:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848512 00000100:00100000:3.0:1790895458.776786:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848768 00000100:00100000:3.0:1790895458.776789:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848768 00000100:00100000:3.0:1790895458.776805:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848384 00000100:00100000:3.0:1790895458.776807:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848384 00000100:00100000:3.0:1790895458.776820:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790895458.776828:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758848512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.776900:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758848512:12345-0@lo:400:kworker.0 Request processed in 71us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895458.776907:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1790895458.776925:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790895458.776931:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758848768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.776975:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758848768:12345-0@lo:400:kworker.0 Request processed in 44us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895458.776981:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1790895458.776993:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1790895458.776999:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758848384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.777024:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758848384:12345-0@lo:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895458.777029:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:3.0:1790895458.777045:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895458.777072:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758848384:0@lo:400:kworker.0 00000100:00100000:3.0:1790895458.777083:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758848768:0@lo:400:kworker.0 00000100:00100000:0.0:1790895458.777251:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848256 00000100:00100000:0.0:1790895458.777256:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848256 00000100:00100000:0.0:1790895458.777292:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1790895458.777299:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758848256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895458.777341:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758848256:12345-0@lo:400:kworker.0 Request processed in 43us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895458.777347:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1790895458.777389:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758848512:0@lo:400:kworker.0 00000100:00100000:0.0:1790895458.777410:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758848256:0@lo:400:kworker.0 00000100:00100000:1.0:1790895458.777777:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848640 00000100:00100000:1.0:1790895458.777782:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848640 00000100:00100000:1.0:1790895458.777832:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758848896 00000100:00100000:1.0:1790895458.777836:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758848896 00000100:00100000:1.0:1790895458.777882:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790895458.777891:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758848640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895458.777939:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758848640:12345-0@lo:400:kworker.0 Request processed in 50us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895458.777945:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790895458.777957:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790895458.777973:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758848896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895458.778012:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758848896:12345-0@lo:400:kworker.0 Request processed in 40us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895458.778017:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790895458.778051:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758848640:0@lo:400:kworker.0 00010000:00080000:1.0:1790895458.778078:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf3060c3100 x1877889758848896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895458.778088:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758848896:0@lo:400:kworker.0 00000100:00080000:3.0:1790895458.778196:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895458.778200:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895458.778441:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790895458.778453:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758849024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895458.778491:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895458.778805:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849024 00000100:00100000:2.0:1790895458.778811:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849024 00000100:00100000:2.0:1790895458.778882:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790895458.778891:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758849024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895458.778938:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895458.781804:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758849024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2904us (3301us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895458.781818:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1790895458.782539:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340632300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758849024:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790895459.032091:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895459.289310:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758849152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790895459.289382:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895459.289547:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849152 00000100:00100000:3.0:1790895459.289556:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849152 00000100:00100000:3.0:1790895459.289604:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790895459.289614:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758849152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895459.289662:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895459.289720:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758849152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895459.289727:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1790895459.289946:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf33a814380 x1877889758849152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895459.289966:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758849152:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1790895460.069179:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790895460.402331:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:0.0:1790895460.402352:0:6715:0:(genops.c:885:class_export_put()) final put ffff8cf3368a3000/5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:2.0:1790895460.402408:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3368a3000/5979f259-4636-4129-bc0f-4cbabdd61a69 for lustre-OST0000 00000020:00000080:2.0:1790895460.402461:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf3368a6800 for lustre-OST0000 00010000:00010000:0.0:1790895461.080766:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895462.115077:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895462.281381:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895462.281425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895462.281447:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895462.281476:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988800 00000100:00100000:3.0:1790895462.281486:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988800 00000100:00100000:3.0:1790895462.281555:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988928 00000100:00100000:3.0:1790895462.281559:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988928 00000100:00100000:3.0:1790895462.281582:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:3.0:1790895462.281593:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740988800:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895462.281676:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889740988800:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 84us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895462.281684:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:3.0:1790895462.281703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00100000:3.0:1790895462.281710:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740988928:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895462.281734:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889740988928:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895462.281741:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00080000:3.0:1790895462.281757:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895462.282139:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740988672 00000100:00100000:1.0:1790895462.282146:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740988672 00000100:00100000:1.0:1790895462.282185:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 280 00000100:00100000:1.0:1790895462.282193:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740988672:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895462.282233:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889740988672:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 41us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895462.282239:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 280 00010000:00010000:1.0:1790895463.129348:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895463.257497:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790895463.898133:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758849280:0@lo:400:kworker.0 00000100:00100000:2.0:1790895463.898200:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758849536:0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.898226:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895463.898312:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758849664:0@lo:400:kworker.0 00000100:00100000:2.0:1790895463.901914:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895463.902499:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758850048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895463.902540:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895463.902603:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849536 00000100:00100000:2.0:1790895463.902614:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849536 00000100:00100000:2.0:1790895463.902673:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790895463.902683:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758849536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895463.902749:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340631880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758849536:12345-0@lo:400:kworker.0 Request processed in 68us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895463.902756:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1790895463.902780:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758850048 00000100:00100000:2.0:1790895463.902784:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758850048 00000100:00100000:2.0:1790895463.902813:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790895463.902820:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758850048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895463.903452:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895463.903515:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340631f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758850048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 695us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895463.903523:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1790895463.903560:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790895463.903566:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895463.903608:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758849536:0@lo:400:kworker.0 00000100:00100000:2.0:1790895463.903628:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340631180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758850048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895463.903685:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849280 00000100:00100000:2.0:1790895463.903691:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849280 00000100:00100000:2.0:1790895463.903739:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790895463.903747:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758849280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895463.903783:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758849280:12345-0@lo:400:kworker.0 Request processed in 37us (5558us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895463.903790:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1790895463.903832:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758849408:0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.905429:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758849280:0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.905443:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758849792:0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.905483:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895463.905521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849792 00000100:00100000:0.0:1790895463.905529:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849792 00000100:00100000:0.0:1790895463.905587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1790895463.905595:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758849792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.905643:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758849792:12345-0@lo:400:kworker.0 Request processed in 48us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895463.905649:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1790895463.905673:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895463.905693:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758849792:0@lo:400:kworker.0 00000100:00100000:2.0:1790895463.906041:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895463.906088:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758849920:0@lo:400:kworker.0 00000100:00100000:2.0:1790895463.906117:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895463.907547:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849408 00000100:00100000:0.0:1790895463.907559:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849408 00000100:00100000:0.0:1790895463.907608:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790895463.907618:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758849408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.907691:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340631180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758849408:12345-0@lo:400:kworker.0 Request processed in 75us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895463.907699:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1790895463.907739:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849920 00000100:00100000:0.0:1790895463.907743:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849920 00000100:00100000:0.0:1790895463.907786:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790895463.907793:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758849920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.907831:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758849920:12345-0@lo:400:kworker.0 Request processed in 38us (1713us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895463.907838:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1790895463.907873:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758849408:0@lo:400:kworker.0 00010000:00080000:2.0:1790895463.907893:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf338c22300 x1877889758849920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1790895479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1790895463.907900:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790895463.907905:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758849920:0@lo:400:kworker.0 00000100:00100000:1.0:1790895463.914137:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895463.914394:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758849664 00000100:00100000:0.0:1790895463.914405:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758849664 00000100:00100000:0.0:1790895463.914466:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790895463.914477:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758849664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895463.914538:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758849664:12345-0@lo:400:kworker.0 Request processed in 63us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895463.914546:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1790895463.915429:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758849664:0@lo:400:kworker.0 00000001:02000400:3.0:1790895464.088255:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 18:57:43 (1790895463) 00010000:00010000:1.0:1790895464.152996:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895464.408477:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758850176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895464.408566:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895464.408957:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758850176 00000100:00100000:0.0:1790895464.408967:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758850176 00000100:00100000:0.0:1790895464.409196:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790895464.409207:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758850176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895464.409259:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895464.409339:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340633480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758850176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895464.409346:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1790895464.409428:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf336be5880 x1877889758850176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895464.409452:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758850176:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1790895465.178712:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895465.589699:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895465.593460:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740989056 00000100:00100000:0.0:1790895465.593479:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740989056 00000100:00100000:0.0:1790895465.593591:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:0.0:1790895465.593609:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:10234:x1877889740989056:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895465.593647:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895465.593692:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8942 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cc8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.593766:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8949 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.593781:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.593796:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790895465.593802:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1790895465.593832:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790895465.593836:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895465.593897:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8949 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.593922:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8942 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cc8 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.593942:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8949 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cc8 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.593951:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895465.593954:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895465.593958:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d800, rc 0) 00000100:00100000:0.0:1790895465.594035:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:10234:x1877889740989056:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 434us (4347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895465.594052:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:1.0:1790895465.617847:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895465.618002:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740989184 00000100:00100000:0.0:1790895465.618033:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740989184 00000100:00100000:0.0:1790895465.618124:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:0.0:1790895465.618134:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:10235:x1877889740989184:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895465.618156:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895465.618176:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8950 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ccf expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618242:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618256:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618269:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618283:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618289:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618296:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618739:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8965 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618749:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8965 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618756:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8965 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895465.618792:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790895465.618796:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895465.618815:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8965 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618825:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618832:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618839:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618845:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895465.618850:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618895:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618909:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895465.618912:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895465.618916:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618922:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618934:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618952:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618957:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618963:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895465.618966:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618972:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618980:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cf31037cb00) 00010000:00010000:0.0:1790895465.618982:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895465.618984:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.618990:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf895e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.619020:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8950 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ccf expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.619032:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8965 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ccf expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895465.619050:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:0.0:1790895465.619052:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895465.619060:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7da00, rc 0) 00000100:00100000:0.0:1790895465.619292:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:10235:x1877889740989184:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 1158us (1453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895465.619301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:3.0:1790895465.626174:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895465.626334:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740989440 00000100:00100000:1.0:1790895465.626358:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740989440 00000100:00100000:1.0:1790895465.626424:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:1.0:1790895465.626446:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:10235:x1877889740989440:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895465.626470:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895465.626494:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf896c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cd6 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.626576:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.626592:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.626605:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.626643:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.626651:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.626684:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627535:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d200/0x7911a98710cf8981 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627548:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d200/0x7911a98710cf8981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627557:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d200/0x7911a98710cf8981 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895465.627568:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1790895465.627723:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627732:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627739:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627745:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895465.627750:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627757:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627770:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:1.0:1790895465.627773:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895465.627786:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627793:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8973 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627808:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627814:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627820:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627825:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895465.627828:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627833:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627841:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cf314095500) 00010000:00010000:1.0:1790895465.627843:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895465.627847:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.627853:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf897a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.629328:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf896c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cd6 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.629371:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d200/0x7911a98710cf8981 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cd6 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895465.629380:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:1.0:1790895465.629383:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895465.629386:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d200, rc 0) 00000100:00100000:1.0:1790895465.630721:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10235:x1877889740989440:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 4278us (4548us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790895465.630733:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:3.0:1790895465.637285:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895465.637980:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740989568 00000100:00100000:2.0:1790895465.637996:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740989568 00000100:00100000:2.0:1790895465.638101:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:2.0:1790895465.638136:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10235:x1877889740989568:12345-192.168.201.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790895465.638271:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10235:x1877889740989568:12345-192.168.201.54@tcp:59:lhsmtool_posix.0 Request processed in 141us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895465.638279:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 35 00010000:00010000:1.0:1790895466.200180:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895466.328469:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1790895467.227975:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895467.401733:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895467.401786:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895467.402287:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740989696 00000100:00100000:3.0:1790895467.402298:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740989696 00000100:00100000:3.0:1790895467.402358:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 282 00000100:00100000:3.0:1790895467.402369:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889740989696:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895467.402440:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889740989696:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 73us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895467.402448:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 282 00000100:00100000:0.0:1790895467.407053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740989824 00000100:00100000:0.0:1790895467.407070:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740989824 00000100:00100000:0.0:1790895467.407229:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 123 00000100:00100000:0.0:1790895467.407240:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2364:x1877889740989824:12345-192.168.201.54@tcp:400:kworker.0 00000100:00080000:2.0:1790895467.407355:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895467.407389:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2364:x1877889740989824:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 150us (5601us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895467.407397:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 123 00000100:00100000:2.0:1790895467.407442:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895467.407482:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740989952 00000100:00100000:0.0:1790895467.407487:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740989952 00000100:00100000:0.0:1790895467.407520:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 124 00000100:00100000:0.0:1790895467.407527:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740989952:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895467.407561:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340633800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889740989952:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 34us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895467.407568:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 124 00000100:00080000:2.0:1790895467.407579:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895467.691148:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895467.692254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740990080 00000100:00100000:3.0:1790895467.692274:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740990080 00000100:00100000:3.0:1790895467.692333:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:3.0:1790895467.692344:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10278:x1877889740990080:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895467.692366:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895467.692387:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf898f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cdd expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692450:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692465:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692478:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692495:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692502:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692509:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692796:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692805:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692812:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692824:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cb200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895467.692829:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692837:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692850:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:3.0:1790895467.692854:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895467.692934:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692942:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8996 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692954:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692960:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692966:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692971:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cae00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895467.692974:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692980:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.692999:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cf3183e2800) 00010000:00010000:3.0:1790895467.693014:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895467.693018:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.693024:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf899d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.693063:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf898f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cdd expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.693073:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:3.0:1790895467.693076:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895467.693080:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf898f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cdd expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.693089:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029ca000, rc 0) 00000100:00100000:3.0:1790895467.693158:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340633b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10278:x1877889740990080:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 815us (2019us total) trans 0 rc 301/301 00000100:00100000:3.0:1790895467.693165:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:2.0:1790895467.701325:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895467.702483:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740990336 00000100:00100000:0.0:1790895467.702495:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740990336 00000100:00100000:0.0:1790895467.702649:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:0.0:1790895467.702662:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10278:x1877889740990336:12345-192.168.201.54@tcp:36:lfs.0 00010000:00010000:0.0:1790895467.702715:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895467.702742:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8949 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cc8 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.702775:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895467.702787:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895467.703039:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.703054:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.703064:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.703077:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.703084:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.703092:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895467.704019:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790895467.704035:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.704042:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.704049:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.704056:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895467.704067:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.704076:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.704087:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895467.704091:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895467.704094:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.704101:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89a4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895467.704119:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbd58d25 reply state 00000000cdedadd5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895467.704129:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790895467.704261:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340631c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+10:10278:x1877889740990336:12345-192.168.201.54@tcp:36:lfs.0 Request processed in 1601us (2944us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1790895467.704270:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 37 00010000:00010000:2.0:1790895467.708729:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895467.708749:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895467.708758:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895467.708765:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895467.708770:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895467.708781:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895467.708801:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cf31037cc00) 00010000:00010000:2.0:1790895467.708811:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895467.708817:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895467.708823:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ab lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895467.778619:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895467.778665:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740990464 00000100:00100000:3.0:1790895467.778677:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740990464 00000100:00100000:3.0:1790895467.778742:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:3.0:1790895467.778751:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10286:x1877889740990464:12345-192.168.201.54@tcp:101:lctl.0 00010000:00010000:3.0:1790895467.778772:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895467.778793:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf89b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ce4 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.778923:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf89b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.778934:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf89b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.778942:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf89b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895467.778971:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790895467.778974:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895467.779015:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf89b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.779050:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf89b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ce4 expref: 11 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.779070:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf89b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ce4 expref: 10 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895467.779079:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:3.0:1790895467.779082:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895467.779086:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf3029cae00, rc 0) 00000100:00100000:3.0:1790895467.779149:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+10:10286:x1877889740990464:12345-192.168.201.54@tcp:101:lctl.0 Request processed in 398us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895467.779156:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:2.0:1790895467.821087:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895467.821176:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740990592 00000100:00100000:1.0:1790895467.821186:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740990592 00000100:00100000:1.0:1790895467.821264:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:1.0:1790895467.821273:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+10:10292:x1877889740990592:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:1.0:1790895467.821294:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895467.821316:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf89c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ceb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821381:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821395:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821406:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821439:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821447:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821453:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821562:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf89d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821571:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf89d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821578:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf89d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895467.821607:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1790895467.821610:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895467.821650:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf89d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821661:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821668:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821674:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821816:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895467.821822:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821831:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821843:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:1.0:1790895467.821845:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895467.821850:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821949:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf89c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821964:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821970:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821977:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821981:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895467.821984:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.821989:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.822130:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8cf314095e00) 00010000:00010000:1.0:1790895467.822133:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895467.822136:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.822142:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf89ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.822174:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf89c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ceb expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.822187:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf89d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ceb expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.822194:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895467.822196:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790895467.822198:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91dc00, rc 0) 00000100:00100000:1.0:1790895467.822291:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340632a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10292:x1877889740990592:12345-192.168.201.54@tcp:101:bash.0 Request processed in 1018us (1214us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895467.822329:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:3.0:1790895467.824842:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895467.824992:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740990848 00000100:00100000:0.0:1790895467.825016:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740990848 00000100:00100000:0.0:1790895467.825070:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:0.0:1790895467.825080:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10292:x1877889740990848:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895467.825100:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895467.825119:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cf2 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.825252:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.825281:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.825293:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.825358:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.825366:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.825373:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790895467.826041:0:7639:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1790895467.826213:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826223:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826231:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826263:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826271:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826278:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826290:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895467.826294:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826301:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826313:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895467.826317:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895467.826322:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826328:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf89e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895467.826344:0:7639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009f34b534 reply state 00000000844b29e1 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895467.826352:0:7639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790895467.826384:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf89dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 14 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826397:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 13 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.826404:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895467.826406:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895467.826408:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d600, rc 0) 00000100:00100000:0.0:1790895467.826479:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10292:x1877889740990848:12345-192.168.201.54@tcp:101:bash.0 Request processed in 1399us (1645us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1790895467.826493:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:2.0:1790895467.831946:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00010000:00010000:0.0:1790895467.832059:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.832071:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.832080:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.832086:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895467.832090:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.832098:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.832116:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf31037cb00) 00010000:00010000:0.0:1790895467.832119:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895467.832124:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.832130:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf89ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895467.832356:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740990976 00000100:00100000:1.0:1790895467.832367:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740990976 00000100:00100000:1.0:1790895467.832678:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:1.0:1790895467.832687:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1877889740990976:12345-192.168.201.54@tcp:8:bash.0 00010000:00080000:1.0:1790895467.832722:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp t0 exp 0000000000000000 cur 340 last 0 00000020:00000080:1.0:1790895467.832751:0:6690:0:(genops.c:1384:class_connect()) connect: client 5979f259-4636-4129-bc0f-4cbabdd61a69, cookie 0x7911a98710cf89ff 00002000:00100000:1.0:1790895467.832763:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5979f259-4636-4129-bc0f-4cbabdd61a69/ffff8cf302ca2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1790895467.832802:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1790895467.833066:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1790895467.833101:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cf302ca5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895467.833171:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2360:x1877889740990976:12345-192.168.201.54@tcp:8:bash.0 Request processed in 483us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895467.833180:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:3.0:1790895467.837180:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895467.837557:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740991104 00000100:00100000:0.0:1790895467.837568:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740991104 00000100:00100000:0.0:1790895467.837646:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:0.0:1790895467.837658:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:0:x1877889740991104:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895467.837676:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895467.837707:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2cf9 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790895467.837737:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790895467.837757:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=340s v=(0 0) 00010000:00010000:0.0:1790895467.837762:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895467.837772:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.837794:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.837808:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7de00, rc 0) 00000100:00100000:0.0:1790895467.837915:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:0:x1877889740991104:12345-192.168.201.54@tcp:101:bash.0 Request processed in 260us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895467.837922:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00080000:2.0:1790895467.838096:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790895467.841987:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895467.842115:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740991232 00000100:00100000:1.0:1790895467.842125:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740991232 00000100:00100000:1.0:1790895467.842187:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:1.0:1790895467.842197:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:10292:x1877889740991232:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:1.0:1790895467.842217:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895467.842242:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d00 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.842275:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.842284:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895467.842289:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895467.842294:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.842329:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.842359:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 8 pid: 6691 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895467.842403:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1877889758850304:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895467.842561:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf302b8cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790895467.850042:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6690:1877889758850304:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895467.850083:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 8 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895467.850106:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91da00, rc 0) 00000100:00100000:1.0:1790895467.850168:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+8:10292:x1877889740991232:12345-192.168.201.54@tcp:101:bash.0 Request processed in 7971us (8190us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895467.850178:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:2.0:1790895467.850460:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895467.850528:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740991360 00000100:00100000:0.0:1790895467.850550:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740991360 00010000:00010000:0.0:1790895467.850585:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 8 pid: 6691 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895467.850617:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:0.0:1790895467.850626:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889740991360:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895467.850640:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895467.850665:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 8 pid: 6691 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.850706:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 8 pid: 6691 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.850732:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000755d87df/0x7911a98710cf8a06 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf9 expref: 8 pid: 6691 timeout: 440 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.850747:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895467.850751:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895467.850759:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.850770:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.850810:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895467.850825:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5818:1877889758850432:192.168.201.54@tcp:105: 00000100:00100000:0.0:1790895467.850956:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3064996c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895467.858080:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5818:1877889758850432:192.168.201.54@tcp:105: 00010000:00010000:2.0:1790895467.858110:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895467.858174:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889740991360:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 7547us (7713us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895467.858185:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:2.0:1790895467.860117:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895467.860231:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740991616 00000100:00100000:1.0:1790895467.860244:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740991616 00000100:00100000:1.0:1790895467.860313:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:1.0:1790895467.860327:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+13:10292:x1877889740991616:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:1.0:1790895467.860729:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10292:x1877889740991616:12345-192.168.201.54@tcp:35:bash.0 Request processed in 405us (620us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1790895467.860737:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:3.0:1790895467.972189:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895467.972331:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740991872 00000100:00100000:0.0:1790895467.972343:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740991872 00000100:00100000:0.0:1790895467.972414:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:0.0:1790895467.972425:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10302:x1877889740991872:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895467.972452:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895467.972501:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d07 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895467.972618:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1790895467.972747:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8a14 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d07 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.972760:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:0.0:1790895467.972763:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895467.972768:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d07 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895467.972782:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895467.972850:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10302:x1877889740991872:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 425us (670us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1790895467.972910:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:0.0:1790895467.976105:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895467.976186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740992128 00000100:00100000:1.0:1790895467.976195:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740992128 00000100:00100000:1.0:1790895467.976256:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:1.0:1790895467.976266:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10302:x1877889740992128:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895467.976517:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10302:x1877889740992128:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 251us (420us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790895467.976541:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:2.0:1790895468.046262:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.046343:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740992256 00000100:00100000:0.0:1790895468.046355:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740992256 00000100:00100000:0.0:1790895468.046458:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:0.0:1790895468.046469:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10308:x1877889740992256:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895468.046494:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895468.046517:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d0e expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.046588:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8a29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.046603:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.046631:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895468.046668:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790895468.046672:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895468.046704:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8a29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.046734:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d0e expref: 18 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.046751:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8a29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d0e expref: 17 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.046760:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895468.046763:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895468.046768:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d800, rc 0) 00000100:00100000:0.0:1790895468.046836:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340632680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10308:x1877889740992256:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 368us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895468.046843:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:3.0:1790895468.056715:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.056805:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740992512 00000100:00100000:0.0:1790895468.056818:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740992512 00000100:00100000:0.0:1790895468.056902:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:0.0:1790895468.056913:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10308:x1877889740992512:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895468.056935:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895468.056956:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8a30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d15 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.057096:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.057110:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.057121:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895468.057131:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790895468.057261:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8a30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d15 expref: 20 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.057280:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d15 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.057288:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895468.057292:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895468.057295:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7ca00, rc 0) 00000100:00100000:0.0:1790895468.057360:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10308:x1877889740992512:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 449us (655us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1790895468.057367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:3.0:1790895468.063361:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895468.063417:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.063663:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740992896 00000100:00100000:0.0:1790895468.063677:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740992896 00000100:00100000:0.0:1790895468.063757:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:0.0:1790895468.063769:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+19:2363:x1877889740992896:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895468.063789:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895468.063835:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d15 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.063855:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895468.063905:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895468.063956:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+18:2363:x1877889740992896:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 189us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895468.063963:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:2.0:1790895468.065016:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740992768 00000100:00100000:2.0:1790895468.065029:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740992768 00000100:00100000:2.0:1790895468.065085:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:2.0:1790895468.065096:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+18:10308:x1877889740992768:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895468.065120:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895468.065141:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d1c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.065249:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8a4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.065276:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.065288:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8a4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895468.065304:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1790895468.065670:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d1c expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.065700:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d1c expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.065709:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:2.0:1790895468.065712:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790895468.065716:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f200, rc 0) 00000100:00100000:2.0:1790895468.065827:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+20:10308:x1877889740992768:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 732us (2475us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1790895468.065834:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:3.0:1790895468.080218:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.080290:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740993024 00000100:00100000:0.0:1790895468.080301:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740993024 00000100:00100000:0.0:1790895468.080366:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:0.0:1790895468.080377:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889740993024:12345-192.168.201.54@tcp:1:lfs.0 00010000:00010000:0.0:1790895468.080432:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.080452:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.080462:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1790895468.080466:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895468.080471:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.080513:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 7 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.080550:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 7 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895468.080578:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758850560:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895468.080665:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895468.088402:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.088723:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758850560:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895468.088755:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895468.088855:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740993152 00000100:00100000:2.0:1790895468.088894:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740993152 00002000:00100000:2.0:1790895468.088943:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cf3060c2d80 x1877889740993152/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:749/0 lens 504/0 e 0 to 0 dl 1790895479 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1790895468.088953:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3060c2d80 with x1877889740993152 ext(0->12) 00010000:00010000:2.0:1790895468.088960:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 8 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.089019:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 8 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895468.089029:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf3060c2d80 00000100:00100000:2.0:1790895468.089061:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:2.0:1790895468.089072:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889740993152:12345-192.168.201.54@tcp:4:lfs.0 00000001:00100000:0.0:1790895468.107248:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000100:00100000:0.0:1790895468.107890:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2362:x1877889740993152:12345-192.168.201.54@tcp:4:lfs.0 Request processed in 18814us (19501us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1790895468.107908:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00002000:00100000:0.0:1790895468.107922:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff8cf3060c2d80 x1877889740993152/t4294967299(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:749/0 lens 504/448 e 0 to 0 dl 1790895479 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895468.107934:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3060c2d80 with x1877889740993152 ext(0->12) 00010000:00010000:0.0:1790895468.107945:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 9 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.108825:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 9 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790895468.108838:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf3060c2d80 00000100:00100000:3.0:1790895468.109975:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.110024:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740993280 00000100:00100000:0.0:1790895468.110035:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740993280 00010000:00010000:0.0:1790895468.110074:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 9 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895468.110124:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:0.0:1790895468.110134:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2364:x1877889740993280:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895468.110151:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790895468.110171:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790895468.110174:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1790895468 00002000:00010000:0.0:1790895468.110177:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1790895468 00002000:00010000:0.0:1790895468.110179:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1790895468 00010000:00010000:0.0:1790895468.110185:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 9 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.110210:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 9 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.110301:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf8a0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d00 expref: 9 pid: 6690 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.110319:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895468.110323:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895468.110330:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.110340:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.110371:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895468.110402:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.110416:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895468.110434:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2364:x1877889740993280:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 300us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895468.110443:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 36 00010000:00010000:2.0:1790895468.110452:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.110463:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.110471:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.110478:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895468.110483:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.110504:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.110519:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.110527:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf8a5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895468.110579:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889740993024:12345-192.168.201.54@tcp:1:lfs.0 Request processed in 30204us (30368us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895468.110587:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:3.0:1790895468.113231:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.113347:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740993536 00000100:00100000:1.0:1790895468.113358:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740993536 00000100:00100000:1.0:1790895468.113499:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:1.0:1790895468.113512:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:10308:x1877889740993536:12345-192.168.201.54@tcp:35:lfs.0 00000004:00010000:1.0:1790895468.113581:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8a4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d1c expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895468.113915:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:1.0:1790895468.113975:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1790895468.114489:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:1.0:1790895468.114543:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.114558:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 24 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.114567:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.114601:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 24 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.114629:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 24 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895468.114645:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1877889758850688:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895468.115176:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf302b8ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895468.117102:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1877889758850688:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895468.117134:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895468.117852:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.118321:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740993664 00000100:00100000:0.0:1790895468.118331:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740993664 00010000:00010000:0.0:1790895468.118373:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 25 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895468.118417:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:0.0:1790895468.118427:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+25:2361:x1877889740993664:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895468.118443:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895468.118449:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 25 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.118475:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 25 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.118507:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf89f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cf2 expref: 25 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.118524:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895468.119228:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.119302:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.119310:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.119578:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895468.119619:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895468.119630:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895468.119653:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+24:2361:x1877889740993664:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 1224us (1801us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895468.119662:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 37 00000001:00080000:3.0:1790895468.119765:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:3.0:1790895468.120025:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:3.0:1790895468.120149:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758850816:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790895468.120259:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895468.120326:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758850816 00000100:00100000:1.0:1790895468.120333:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758850816 00000100:00080000:2.0:1790895468.120478:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895468.120610:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895468.120622:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877889758850816:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790895468.120691:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877889758850816:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895468.120699:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790895468.121746:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180daa80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895468.121890:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3077ab480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758850816:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790895468.122853:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1790895468.122964:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340630000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758850944:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790895468.123231:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895468.123335:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098300 going to sleep for 11 seconds 00000100:00100000:1.0:1790895468.123385:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758850944 00000100:00100000:1.0:1790895468.123400:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758850944 00000100:00100000:1.0:1790895468.123658:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895468.123670:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877889758850944:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790895468.123853:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340632300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5835:x1877889758850944:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 186us (621us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1790895468.123885:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895468.123964:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340630000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758850944:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1790895468.124102:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1790895468.124141:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.124151:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.124172:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.124179:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895468.124184:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.124193:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.124209:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:2.0:1790895468.124212:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1790895468.124217:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.124223:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a61 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790895468.124423:0:5835:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1790895468.124687:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1790895468.124697:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 341091838306ns, next at 342091836103ns, rc = 0 00000001:00080000:2.0:1790895468.124702:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1790895468.124725:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:2.0:1790895468.124727:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790895468.124732:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8a4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d1c expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895468.124880:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10308:x1877889740993536:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 11350us (11638us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1790895468.124893:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000020:00080000:2.0:1790895468.124897:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790895468.126974:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.127098:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740993792 00000100:00100000:0.0:1790895468.127109:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740993792 00000100:00100000:0.0:1790895468.127169:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:0.0:1790895468.127180:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10308:x1877889740993792:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895468.127203:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895468.127226:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8a68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d23 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.127283:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d23 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.127297:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d23 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.127316:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895468.127320:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895468.127324:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895468.127386:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+28:10308:x1877889740993792:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 209us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895468.127393:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:1.0:1790895468.132944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895468.133107:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740994048 00000100:00100000:2.0:1790895468.133118:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740994048 00000100:00100000:2.0:1790895468.133224:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:2.0:1790895468.133247:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+28:10308:x1877889740994048:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895468.133538:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+29:10308:x1877889740994048:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 304us (683us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1790895468.133547:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:3.0:1790895468.198920:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.199083:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740994304 00000100:00100000:1.0:1790895468.199095:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740994304 00000100:00100000:1.0:1790895468.199159:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:1.0:1790895468.199169:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+29:10318:x1877889740994304:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895468.199214:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895468.199306:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d2a expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895468.199403:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790895468.199526:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8a6f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d2a expref: 31 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.199539:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:1.0:1790895468.199542:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790895468.199547:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d2a expref: 31 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.199561:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c400, rc 0) 00000100:00100000:1.0:1790895468.199628:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+30:10318:x1877889740994304:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 460us (718us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1790895468.199635:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:3.0:1790895468.202315:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.202392:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740994432 00000100:00100000:1.0:1790895468.202402:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740994432 00000100:00100000:1.0:1790895468.202465:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:1.0:1790895468.202476:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+30:10318:x1877889740994432:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:1.0:1790895468.202614:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202631:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202643:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202675:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202684:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202697:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202788:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202797:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202803:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895468.202843:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202854:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202882:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202889:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202894:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895468.202898:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202912:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202924:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895468.202926:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895468.202931:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202937:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8a7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202949:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202954:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202960:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202977:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895468.202980:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202985:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.202991:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf314095e00) 00010000:00010000:1.0:1790895468.203003:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895468.203006:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203022:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203037:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203042:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203048:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203053:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895468.203056:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203061:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203068:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895468.203070:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895468.203073:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.203078:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895468.203158:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+30:10318:x1877889740994432:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 682us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895468.203165:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:3.0:1790895468.205297:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.205466:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740994688 00000100:00100000:1.0:1790895468.205478:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740994688 00000100:00100000:1.0:1790895468.205550:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:1.0:1790895468.205560:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+30:10318:x1877889740994688:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895468.205793:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+31:10318:x1877889740994688:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 234us (504us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1790895468.205800:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:3.0:1790895468.237931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.238191:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740994944 00000100:00100000:1.0:1790895468.238202:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740994944 00000100:00100000:1.0:1790895468.238276:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:1.0:1790895468.238287:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+31:10321:x1877889740994944:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895468.238312:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895468.238333:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d31 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238411:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238428:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238440:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238454:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238461:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238503:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238625:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238633:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238641:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895468.238650:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790895468.238760:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238768:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238774:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238780:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895468.238785:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238792:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238804:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895468.238807:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895468.238819:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238825:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8a99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238839:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238844:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238850:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238889:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895468.238893:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238899:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238907:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf314095e00) 00010000:00010000:1.0:1790895468.238909:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895468.238912:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238917:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8aa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.238963:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8a92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 34 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.239022:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 33 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.239030:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895468.239032:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895468.239035:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c400, rc 0) 00000100:00100000:1.0:1790895468.239098:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+33:10321:x1877889740994944:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 813us (1177us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1790895468.239106:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:3.0:1790895468.241777:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.241892:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740995072 00000100:00100000:0.0:1790895468.241902:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740995072 00000100:00100000:0.0:1790895468.241955:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:0.0:1790895468.241978:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+33:10321:x1877889740995072:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:0.0:1790895468.242058:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242097:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242111:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242143:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242150:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242158:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242165:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895468.242170:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242179:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242192:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895468.242196:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895468.242202:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.242209:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ab5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895468.242303:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+33:10321:x1877889740995072:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 338us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895468.242318:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:3.0:1790895468.245472:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.245602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740995328 00000100:00100000:1.0:1790895468.245612:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740995328 00000100:00100000:1.0:1790895468.245668:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:1.0:1790895468.245679:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+33:10321:x1877889740995328:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895468.246004:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+34:10321:x1877889740995328:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 317us (531us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1790895468.246012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00010000:00010000:0.0:1790895468.248356:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895468.599456:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.603269:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740995584 00000100:00100000:1.0:1790895468.603284:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740995584 00000100:00100000:1.0:1790895468.603353:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:1.0:1790895468.603363:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+34:10352:x1877889740995584:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:1.0:1790895468.603388:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895468.603408:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8abc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d38 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.603510:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8ac3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.603540:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.603552:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895468.603565:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1790895468.603711:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8abc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d38 expref: 37 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.603732:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d38 expref: 36 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.603740:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895468.603743:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895468.603747:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ce00, rc 0) 00000100:00100000:1.0:1790895468.603822:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+36:10352:x1877889740995584:12345-192.168.201.54@tcp:101:cat.0 Request processed in 459us (4373us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1790895468.603829:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:3.0:1790895468.608533:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.608964:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740995840 00000100:00100000:1.0:1790895468.608974:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740995840 00000100:00100000:1.0:1790895468.609039:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:1.0:1790895468.609050:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+36:10352:x1877889740995840:12345-192.168.201.54@tcp:35:cat.0 00000100:00100000:1.0:1790895468.609263:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+37:10352:x1877889740995840:12345-192.168.201.54@tcp:35:cat.0 Request processed in 216us (740us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1790895468.609269:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1790895468.609585:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895468.609894:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740995968 00000100:00100000:2.0:1790895468.609954:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740995968 00000100:00100000:2.0:1790895468.610004:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:2.0:1790895468.610013:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306507c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+37:2364:x1877889740995968:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895468.610027:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895468.610049:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf8ac3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d38 expref: 37 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.610066:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895468.610070:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895468.610100:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306507c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+36:2364:x1877889740995968:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 89us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895468.610107:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:3.0:1790895468.684718:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895468.687952:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740996224 00000100:00100000:0.0:1790895468.687967:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740996224 00000100:00100000:0.0:1790895468.688064:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:0.0:1790895468.688077:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+36:10358:x1877889740996224:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:0.0:1790895468.688104:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895468.688107:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790895468.688133:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8a29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d0e expref: 36 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.688153:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895468.688159:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895468.688174:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ad1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d3f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.688278:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.688292:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 36 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.688300:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.688328:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 36 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.688365:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 36 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895468.688376:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758851072:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895468.688469:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3011caa80 going to sleep for 11 seconds 00000100:00100000:3.0:1790895468.693439:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.693907:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740996352 00000100:00100000:1.0:1790895468.693931:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740996352 00010000:00010000:1.0:1790895468.693970:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 37 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895468.694021:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:1.0:1790895468.694031:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+37:2361:x1877889740996352:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895468.694054:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895468.694061:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 37 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.694088:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 37 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.694110:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895468.694115:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.694125:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.694132:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.694149:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895468.694198:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+37:2361:x1877889740996352:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 168us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895468.694204:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 38 00010000:00010000:0.0:1790895468.695222:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8aa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d31 expref: 36 pid: 7639 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895468.695239:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c22d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758851072:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895468.695262:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.695272:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.695278:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895468.695296:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1790895468.695444:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ad1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 37 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.695458:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895468.695466:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895468.695476:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790895468.695490:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d400, rc 0) 00000100:00100000:0.0:1790895468.695532:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+36:10358:x1877889740996224:12345-192.168.201.54@tcp:101:dd.0 Request processed in 7459us (10823us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1790895468.695539:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:3.0:1790895468.700145:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.704313:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740996608 00000100:00100000:1.0:1790895468.704329:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740996608 00000100:00100000:1.0:1790895468.704422:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:1.0:1790895468.704433:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+36:10358:x1877889740996608:12345-192.168.201.54@tcp:36:dd.0 00010000:00010000:1.0:1790895468.704694:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.704714:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.704726:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895468.704796:0:7639:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1790895468.704819:0:7639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000eb3f6d4 reply state 0000000072298b01 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895468.704828:0:7639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895468.705456:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+39:10358:x1877889740996608:12345-192.168.201.54@tcp:36:dd.0 Request processed in 1021us (5320us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1790895468.705464:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 52 00000020:00080000:1.0:1790895468.705470:0:7639:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1790895468.707445:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.707476:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.707484:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.707490:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895468.707495:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.707503:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.707520:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895468.707523:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895468.707528:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895468.707535:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8ae6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895468.991613:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.991740:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740996736 00000100:00100000:1.0:1790895468.991752:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740996736 00000100:00100000:1.0:1790895468.991821:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:1.0:1790895468.991832:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+38:10372:x1877889740996736:12345-192.168.201.54@tcp:101:stat.0 00010000:00010000:1.0:1790895468.991855:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895468.991900:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8aed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d46 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.991978:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992021:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992034:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992051:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992059:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992066:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992144:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992155:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992164:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992196:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 39 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895468.992222:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 39 pid: 5832 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895468.992246:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758851200:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895468.992331:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf302b8cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790895468.994921:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758851200:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895468.994952:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895468.997573:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895468.998383:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740996992 00000100:00100000:1.0:1790895468.998395:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740996992 00000100:00100000:1.0:1790895468.998455:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:1.0:1790895468.998475:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+40:5599:x1877889740996992:12345-192.168.201.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790895469.000519:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+41:5599:x1877889740996992:12345-192.168.201.54@tcp:35:ldlm_bl.0 Request processed in 2043us (2945us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1790895469.000534:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:3.0:1790895469.003276:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.004237:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740997120 00000100:00100000:2.0:1790895469.004250:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740997120 00010000:00010000:2.0:1790895469.004374:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 41 pid: 5832 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895469.004416:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:2.0:1790895469.004429:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+41:2361:x1877889740997120:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895469.004444:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895469.004464:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 41 pid: 5832 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.004500:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 41 pid: 5832 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.004522:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ad8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d3f expref: 41 pid: 5832 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.004540:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895469.004546:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.004555:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.004564:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.004598:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895469.004664:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+40:2361:x1877889740997120:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 229us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.004672:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 39 00010000:00010000:1.0:1790895469.006588:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006606:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895469.006672:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790895469.006677:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895469.006745:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006761:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006789:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006797:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006805:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006811:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.006816:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006824:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006840:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895469.006843:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.006847:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006854:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8af4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006891:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006899:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006905:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006924:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.006927:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006933:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006943:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf314095e00) 00010000:00010000:1.0:1790895469.006945:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.006948:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.006953:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8afb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.007006:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8aed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d46 expref: 40 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.007022:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d46 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.007442:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895469.007447:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895469.007450:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d800, rc 0) 00000100:00100000:1.0:1790895469.007545:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+39:10372:x1877889740996736:12345-192.168.201.54@tcp:101:stat.0 Request processed in 15712us (15942us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.007564:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00080000:0.0:1790895469.008880:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895469.016082:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758851328:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895469.016134:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758851712:0@lo:400:kworker.0 00000100:00100000:0.0:1790895469.016169:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895469.016175:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895469.016217:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895469.016222:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758851584:0@lo:400:kworker.0 00000100:00100000:2.0:1790895469.016238:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895469.016255:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758851328 00000100:00100000:2.0:1790895469.016265:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758851712 00000100:00100000:2.0:1790895469.016278:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758851712 00000100:00100000:1.0:1790895469.016279:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758851328 00000100:00100000:2.0:1790895469.016325:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758851584 00000100:00100000:2.0:1790895469.016327:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758851584 00000100:00100000:2.0:1790895469.016345:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790895469.016350:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758851712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895469.016357:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758851456:0@lo:400:kworker.0 00000100:00100000:3.0:1790895469.016402:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895469.016414:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758851712:12345-0@lo:400:kworker.0 Request processed in 61us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.016423:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1790895469.016443:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790895469.016451:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758851968:0@lo:400:kworker.0 00000100:00100000:2.0:1790895469.016457:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758851584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895469.016481:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758851584:12345-0@lo:400:kworker.0 Request processed in 27us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.016485:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1790895469.016501:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895469.016515:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340632d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758851584:0@lo:400:kworker.0 00000100:00100000:2.0:1790895469.016525:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340633100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758851712:0@lo:400:kworker.0 00000100:00100000:3.0:1790895469.016528:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895469.016538:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758851840:0@lo:400:kworker.0 00000100:00100000:2.0:1790895469.016549:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758851968 00000100:00100000:2.0:1790895469.016563:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758851968 00000100:00100000:3.0:1790895469.016568:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895469.016817:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1790895469.016825:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758851968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895469.016829:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1790895469.016842:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758851328:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895469.016873:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758851968:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.016878:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00002000:00000024:1.0:1790895469.016894:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895469.016904:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758851456 00000100:00100000:2.0:1790895469.016908:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758851456 00000100:00100000:2.0:1790895469.016930:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1790895469.016935:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758851456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895469.016942:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758851328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.016951:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790895469.016969:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758851456:12345-0@lo:400:kworker.0 Request processed in 33us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.016974:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:1.0:1790895469.017004:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1790895469.017010:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895469.017033:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758851840 00000100:00100000:2.0:1790895469.017037:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758851840 00000100:00100000:2.0:1790895469.017061:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790895469.017066:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758851840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895469.017093:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758851840:12345-0@lo:400:kworker.0 Request processed in 27us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.017098:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790895469.017157:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758851328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895469.017560:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc27800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758851840:0@lo:400:kworker.0 00000100:00100000:3.0:1790895469.017571:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758851456:0@lo:400:kworker.0 00000100:00100000:3.0:1790895469.017582:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc25500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758851968:0@lo:400:kworker.0 00000100:00100000:3.0:1790895469.090683:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.090766:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740997376 00000100:00100000:2.0:1790895469.090781:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740997376 00000100:00100000:2.0:1790895469.090885:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 54 00000100:00100000:2.0:1790895469.090898:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+39:10378:x1877889740997376:12345-192.168.201.54@tcp:36:truncate.0 00010000:00010000:2.0:1790895469.090999:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895469.091032:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8b02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d46 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.091050:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895469.091054:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895469.091264:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.091276:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.091283:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790895469.091350:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1790895469.091372:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d2807b70 reply state 000000004bbdbbf6 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895469.091380:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790895469.091494:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+41:10378:x1877889740997376:12345-192.168.201.54@tcp:36:truncate.0 Request processed in 598us (822us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1790895469.091501:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 54 00000020:00080000:2.0:1790895469.091506:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790895469.093420:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895469.093438:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895469.093445:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895469.093451:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895469.093456:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895469.093464:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895469.093492:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895469.093496:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895469.093501:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895469.093523:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895469.260305:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.260420:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740997504 00000100:00100000:1.0:1790895469.260430:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740997504 00000100:00100000:1.0:1790895469.260587:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00100000:1.0:1790895469.260598:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+40:10392:x1877889740997504:12345-192.168.201.54@tcp:101:stat.0 00010000:00010000:1.0:1790895469.260622:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895469.260642:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d4d expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.260755:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.260770:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.260783:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.260796:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.260803:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.260817:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262051:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262067:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262077:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895469.262119:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1790895469.262125:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895469.262152:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262164:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262172:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262178:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262184:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.262190:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.262194:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267713:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267752:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895469.267756:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.267763:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267771:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267793:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267800:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267806:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267812:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.267816:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267824:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267831:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf314095e00) 00010000:00010000:1.0:1790895469.267834:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.267837:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267900:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267965:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 42 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.267993:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 41 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.268001:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895469.268004:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895469.268007:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91cc00, rc 0) 00000100:00100000:1.0:1790895469.268092:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+41:10392:x1877889740997504:12345-192.168.201.54@tcp:101:stat.0 Request processed in 7495us (7797us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.268102:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 55 00010000:00010000:1.0:1790895469.275663:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895469.362951:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.363068:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740997760 00000100:00100000:1.0:1790895469.363078:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740997760 00000100:00100000:1.0:1790895469.363139:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:1.0:1790895469.363150:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+41:10402:x1877889740997760:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895469.363171:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895469.363193:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d54 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895469.363305:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790895469.363433:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b2c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d54 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.363478:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:1.0:1790895469.363482:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790895469.363488:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d54 expref: 43 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.363503:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ca00, rc 0) 00000100:00100000:1.0:1790895469.363568:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+42:10402:x1877889740997760:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 419us (628us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1790895469.363576:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:3.0:1790895469.367360:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.367458:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740998016 00000100:00100000:2.0:1790895469.367479:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740998016 00000100:00100000:2.0:1790895469.367531:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:2.0:1790895469.367541:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+42:10402:x1877889740998016:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895469.367785:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+43:10402:x1877889740998016:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 244us (433us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1790895469.367793:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:3.0:1790895469.434480:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.434609:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740998272 00000100:00100000:2.0:1790895469.434619:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740998272 00000100:00100000:2.0:1790895469.434679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:2.0:1790895469.434699:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+43:10408:x1877889740998272:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895469.434723:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895469.434743:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8b3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d5b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.434838:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.434908:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 44 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.434917:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.434950:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 44 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.435008:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 44 pid: 7639 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895469.435022:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758852096:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895469.435109:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098b40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895469.438460:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.438732:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fc24000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758852096:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895469.438762:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895469.439078:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740998400 00000100:00100000:1.0:1790895469.439087:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740998400 00010000:00010000:1.0:1790895469.439124:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 45 pid: 7639 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895469.439163:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:1.0:1790895469.439172:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+45:2361:x1877889740998400:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895469.439186:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895469.439192:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 45 pid: 7639 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.439321:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 45 pid: 7639 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.439346:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d4d expref: 45 pid: 7639 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.439380:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895469.439386:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.439395:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.439403:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.439475:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895469.439641:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+44:2361:x1877889740998400:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 470us (1189us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.439649:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 40 00010000:00010000:2.0:1790895469.440991:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.441004:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895469.441027:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1790895469.441191:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8b3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.441295:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.441304:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895469.441307:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790895469.441310:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f800, rc 0) 00000100:00100000:2.0:1790895469.441418:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+44:10408:x1877889740998272:12345-192.168.201.54@tcp:101:bash.0 Request processed in 6730us (6958us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1790895469.441427:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:0.0:1790895469.447391:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.447459:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740998656 00000100:00100000:2.0:1790895469.447596:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740998656 00000100:00100000:2.0:1790895469.447685:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 58 00000100:00100000:2.0:1790895469.447706:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+44:10408:x1877889740998656:12345-192.168.201.54@tcp:36:bash.0 00010000:00010000:2.0:1790895469.448009:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.448027:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.448038:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790895469.448088:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1790895469.448112:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000082f9d2ea reply state 00000000786093dd transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895469.448121:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790895469.448235:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+47:10408:x1877889740998656:12345-192.168.201.54@tcp:36:bash.0 Request processed in 540us (852us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1790895469.448242:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 58 00000020:00080000:2.0:1790895469.448247:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790895469.453094:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895469.453112:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895469.453133:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895469.453139:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895469.453144:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895469.453153:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895469.453169:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:3.0:1790895469.453173:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895469.453177:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895469.453183:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8b4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895469.455096:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.455195:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740998784 00000100:00100000:1.0:1790895469.455206:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740998784 00000100:00100000:1.0:1790895469.455260:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:1.0:1790895469.455271:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+46:10408:x1877889740998784:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:1.0:1790895469.455296:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895469.455315:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d62 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.455395:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.455410:0:7639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.455434:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.455479:0:7639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.455611:0:7639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 47 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895469.455627:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758852224:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895469.455716:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3074fa0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895469.457896:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758852224:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895469.457926:0:7639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895469.459051:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.459139:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740998912 00000100:00100000:2.0:1790895469.459148:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740998912 00010000:00010000:2.0:1790895469.459188:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 48 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895469.459229:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:2.0:1790895469.459240:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+48:2362:x1877889740998912:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895469.459254:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895469.459261:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 48 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.459286:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 48 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.459308:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8b41 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d5b expref: 48 pid: 5833 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.459325:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895469.459330:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.459340:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.459348:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.459393:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895469.459454:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+47:2362:x1877889740998912:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 215us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.459461:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 41 00010000:00010000:1.0:1790895469.460024:0:7639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.460033:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895469.460091:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1790895469.460096:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895469.460115:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.460148:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d62 expref: 47 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.460177:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d62 expref: 46 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.460184:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895469.460187:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895469.460190:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ca00, rc 0) 00000100:00100000:1.0:1790895469.460233:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+46:10408:x1877889740998784:12345-192.168.201.54@tcp:101:bash.0 Request processed in 4964us (5145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.460241:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:0.0:1790895469.463002:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.463063:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740999168 00000100:00100000:2.0:1790895469.463072:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740999168 00000100:00100000:2.0:1790895469.463119:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:2.0:1790895469.463127:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+46:10408:x1877889740999168:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:2.0:1790895469.463329:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+47:10408:x1877889740999168:12345-192.168.201.54@tcp:35:bash.0 Request processed in 202us (334us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1790895469.463336:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000004:00080000:1.0:1790895469.528058:0:7922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342495197400ns, next at 343495195330ns, rc = 0 00000100:00100000:2.0:1790895469.528141:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895469.528164:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758852352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895469.528244:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895469.528411:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758852352 00000100:00100000:1.0:1790895469.528419:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758852352 00000100:00100000:1.0:1790895469.528534:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1790895469.528545:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758852352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790895469.528580:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895469.528635:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758852352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.528642:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790895469.528713:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758852352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790895469.536337:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.536417:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740999424 00000100:00100000:1.0:1790895469.536426:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740999424 00000100:00100000:1.0:1790895469.536492:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:1.0:1790895469.536502:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+47:10418:x1877889740999424:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895469.536526:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895469.536546:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b64 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d69 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895469.536660:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1790895469.536808:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b64 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d69 expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.536822:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:1.0:1790895469.536825:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790895469.536830:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d69 expref: 49 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.536850:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91cc00, rc 0) 00000100:00100000:1.0:1790895469.536960:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+48:10418:x1877889740999424:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 459us (631us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1790895469.536967:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:0.0:1790895469.543787:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.543906:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740999552 00000100:00100000:1.0:1790895469.543917:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740999552 00000100:00100000:1.0:1790895469.543980:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:1.0:1790895469.543991:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+48:10418:x1877889740999552:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:1.0:1790895469.544063:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544081:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544092:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544107:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544127:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544134:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544213:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544222:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544229:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895469.544268:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544279:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544286:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544292:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544297:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.544302:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544309:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544325:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895469.544328:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.544333:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544339:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544351:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544357:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544363:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544369:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.544371:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544378:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544384:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf314095e00) 00010000:00010000:1.0:1790895469.544386:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.544389:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544395:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544417:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544422:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544428:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544433:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.544436:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544442:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544455:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895469.544457:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.544467:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.544473:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895469.544547:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+48:10418:x1877889740999552:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 558us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.544555:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:3.0:1790895469.551592:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.551768:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889740999808 00000100:00100000:2.0:1790895469.551779:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889740999808 00000100:00100000:2.0:1790895469.551842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:2.0:1790895469.551885:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+48:10418:x1877889740999808:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895469.552291:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+49:10418:x1877889740999808:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 439us (709us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1790895469.552300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:3.0:1790895469.591995:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.592218:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741000064 00000100:00100000:1.0:1790895469.592227:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741000064 00000100:00100000:1.0:1790895469.592309:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:1.0:1790895469.592329:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+49:10421:x1877889741000064:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895469.592351:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895469.592368:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d70 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592444:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592454:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592461:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592470:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592474:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592477:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592716:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592725:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592733:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895469.592756:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1790895469.592884:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592890:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592894:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592897:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.592900:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592905:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592914:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895469.592916:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.592919:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592922:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8b8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592931:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592935:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592945:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592948:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895469.592950:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592953:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592957:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf314095e00) 00010000:00010000:1.0:1790895469.592958:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895469.592960:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.592963:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf8b95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.593012:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8b87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d70 expref: 52 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.593099:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d70 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.593106:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:1.0:1790895469.593108:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895469.593110:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d000, rc 0) 00000100:00100000:1.0:1790895469.593176:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+51:10421:x1877889741000064:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 847us (1205us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1790895469.593191:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:1.0:1790895469.601052:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.601093:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.601181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741000192 00000100:00100000:2.0:1790895469.601194:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741000192 00000100:00100000:2.0:1790895469.601274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:2.0:1790895469.601284:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+51:10421:x1877889741000192:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:2.0:1790895469.601361:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601381:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601393:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601420:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601426:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601432:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601437:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895469.601441:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601448:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601459:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895469.601462:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790895469.601468:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.601493:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8baa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895469.601657:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+51:10421:x1877889741000192:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 373us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.601664:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:3.0:1790895469.602236:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741000320 00000100:00100000:3.0:1790895469.602244:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741000320 00000100:00100000:3.0:1790895469.602374:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:3.0:1790895469.602384:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+51:2361:x1877889741000320:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895469.602398:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895469.602414:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8b9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d70 expref: 51 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895469.602428:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:3.0:1790895469.602437:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895469.604340:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+50:2361:x1877889741000320:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 1947us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895469.604353:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:0.0:1790895469.604659:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.605011:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741000576 00000100:00100000:2.0:1790895469.605079:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741000576 00000100:00100000:2.0:1790895469.605149:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:2.0:1790895469.605158:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+50:10421:x1877889741000576:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895469.605356:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+51:10421:x1877889741000576:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 199us (697us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1790895469.605363:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:1.0:1790895469.727265:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.727362:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741000832 00000100:00100000:2.0:1790895469.727373:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741000832 00000100:00100000:2.0:1790895469.727432:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:2.0:1790895469.727443:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+51:10439:x1877889741000832:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:2.0:1790895469.727470:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895469.727491:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8bb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d77 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.727618:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8bb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.727644:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.727679:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8bb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895469.728005:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790895469.728157:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8bb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d77 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.728176:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8bb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d77 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.728185:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895469.728188:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790895469.728192:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f400, rc 0) 00000100:00100000:2.0:1790895469.728250:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+53:10439:x1877889741000832:12345-192.168.201.54@tcp:101:cat.0 Request processed in 808us (998us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1790895469.728257:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:3.0:1790895469.758541:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.758678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741000960 00000100:00100000:2.0:1790895469.758695:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741000960 00000100:00100000:2.0:1790895469.758758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 65 00000100:00100000:2.0:1790895469.758777:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+53:10440:x1877889741000960:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895469.758802:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895469.758822:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8bc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d7e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.758915:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8bcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.758948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.758960:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895469.759005:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790895469.759009:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895469.759026:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8bcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.759052:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d7e expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.759071:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8bcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d7e expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.759079:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895469.759082:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895469.759085:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fe00, rc 0) 00000100:00100000:2.0:1790895469.759146:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10440:x1877889741000960:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 371us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.759153:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 65 00000100:00100000:0.0:1790895469.766040:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.766122:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741001344 00000100:00100000:2.0:1790895469.766132:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741001344 00000100:00100000:2.0:1790895469.766193:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:2.0:1790895469.766203:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10440:x1877889741001344:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895469.766539:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10440:x1877889741001344:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 337us (507us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1790895469.766559:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:3.0:1790895469.772602:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.772924:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741001472 00000100:00100000:2.0:1790895469.772935:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741001472 00000100:00100000:2.0:1790895469.773009:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:2.0:1790895469.773029:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10440:x1877889741001472:12345-192.168.201.54@tcp:103:lfs.0 00010000:00010000:2.0:1790895469.773045:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790895469.773068:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf8b5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d62 expref: 55 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.773091:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8bb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d77 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.773105:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d23 expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.773127:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:2.0:1790895469.773139:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895469.773199:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+52:10440:x1877889741001472:12345-192.168.201.54@tcp:103:lfs.0 Request processed in 172us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.773207:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:3.0:1790895469.777628:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895469.777809:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741001600 00000100:00100000:1.0:1790895469.777820:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741001600 00000100:00100000:1.0:1790895469.777906:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00100000:1.0:1790895469.777918:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+52:10440:x1877889741001600:12345-192.168.201.54@tcp:58:lfs.0 00010000:00010000:1.0:1790895469.778690:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.778709:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895469.778721:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790895469.779146:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790895469.780790:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1790895469.780896:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1790895469.782053:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+52:10440:x1877889741001600:12345-192.168.201.54@tcp:58:lfs.0 Request processed in 4130us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895469.782066:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00100000:0.0:1790895469.819278:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895469.819387:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741001728 00000100:00100000:2.0:1790895469.819399:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741001728 00000100:00100000:2.0:1790895469.819474:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 67 00000100:00100000:2.0:1790895469.819487:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+52:10442:x1877889741001728:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895469.819516:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895469.819543:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8bdb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d85 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.819635:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.819650:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.819663:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.819680:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.819688:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.819706:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.819999:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820009:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820016:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895469.820055:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1790895469.820070:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895469.820089:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820110:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820119:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820125:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820132:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820138:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895469.820143:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820151:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820164:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895469.820167:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895469.820172:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820178:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8be2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820192:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820199:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820210:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820215:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895469.820217:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820223:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820231:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf310c7e200) 00010000:00010000:2.0:1790895469.820234:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895469.820237:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820242:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8be9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820275:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8bdb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 54 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820289:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895469.820296:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:2.0:1790895469.820298:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895469.820311:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e800, rc 0) 00000100:00100000:2.0:1790895469.820378:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+53:10442:x1877889741001728:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 896us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895469.820394:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 67 00000001:00080000:0.0:1790895470.107132:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967333 is committed 00000001:00080000:0.0:1790895470.107153:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000004:00080000:0.0:1790895470.107159:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:0.0:1790895470.107262:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000004:00080000:0.0:1790895470.107285:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:0.0:1790895470.107295:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf303098c00 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:0.0:1790895470.107300:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf336bdbf00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf303098f00 00000020:00080000:0.0:1790895470.107304:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf336bdb900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf3368b3000 00000020:00080000:0.0:1790895470.107326:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:0.0:1790895470.107523:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1790895470.107677:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895470.107705:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf307681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758852480:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790895470.107763:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895470.108548:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758852480 00000100:00100000:1.0:1790895470.108559:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758852480 00000100:00100000:1.0:1790895470.108626:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790895470.108636:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1877889758852480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1790895470.108663:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1790895470.108709:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6abee56c, atime: 0x6abee56c, ctime: 0x6abee56c, blocks: 0x1 00010000:00010000:1.0:1790895470.108717:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.108734:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=343s v=(0 0) 00010000:00010000:1.0:1790895470.108738:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895470.108744:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.108762:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.108772:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.108781:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.108800:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:3.0:1790895470.109120:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895470.110310:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3308:x1877889758852480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1671us (2541us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1790895470.110321:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790895470.110353:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895470.110361:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.110372:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91cc00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895470.110383:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.110393:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.110411:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.110419:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b98f6560/0x7911a98710cf8bf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.110439:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895470.110441:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895470.110442:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790895470.113724:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf307681c00/2, rc 0, transno 4294967301 00000100:00100000:3.0:1790895470.113741:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf307681c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758852480:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1790895470.297021:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790895470.428129:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790895470.428143:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790895470.428202:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790895470.428209:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790895470.428363:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33a816d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758852608:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790895470.428689:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3011cae40 going to sleep for 11 seconds 00000100:00100000:0.0:1790895470.442322:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895470.442417:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33a816d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758852608:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790895470.442558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741001856 00000100:00100000:1.0:1790895470.442567:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741001856 00000100:00100000:1.0:1790895470.443153:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:1.0:1790895470.443167:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10453:x1877889741001856:12345-192.168.201.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790895470.443270:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10453:x1877889741001856:12345-192.168.201.54@tcp:900:lhsmtool_posix.0 Request processed in 107us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895470.443277:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:3.0:1790895470.451104:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.452129:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741001984 00000100:00100000:0.0:1790895470.452143:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741001984 00000100:00100000:0.0:1790895470.452270:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:0.0:1790895470.452282:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10453:x1877889741001984:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790895470.452317:0:5832:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790895470.452427:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10453:x1877889741001984:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 148us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895470.452436:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:2.0:1790895470.464102:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895470.464185:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741002112 00000100:00100000:3.0:1790895470.464197:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741002112 00000100:00100000:3.0:1790895470.464258:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:3.0:1790895470.464268:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10453:x1877889741002112:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790895470.464347:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464364:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464376:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464393:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464410:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464416:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464444:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464466:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464474:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895470.464520:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1790895470.464524:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895470.464667:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464681:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464687:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464694:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464700:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029ca000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895470.464704:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464718:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464730:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:3.0:1790895470.464733:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895470.464739:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464745:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029ca000/0x7911a98710cf8bfe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464760:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464765:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464771:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464776:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cb200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895470.464778:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464784:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464790:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895470.464792:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895470.464795:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464809:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cb200/0x7911a98710cf8c05 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464823:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464829:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464835:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464839:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cbc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895470.464842:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464847:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.464853:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:3.0:1790895470.464993:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895470.464998:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.465005:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cbc00/0x7911a98710cf8c0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895470.473918:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10453:x1877889741002112:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 Request processed in 9640us (9818us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895470.473932:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:2.0:1790895470.476225:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895470.476297:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741002368 00000100:00100000:3.0:1790895470.476308:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741002368 00000100:00100000:3.0:1790895470.476359:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 70 00000100:00100000:3.0:1790895470.476370:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10453:x1877889741002368:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895470.476397:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895470.476416:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c13 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d8c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476531:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476559:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476572:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895470.476583:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1790895470.476776:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476784:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476791:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476796:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895470.476800:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476808:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476821:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:3.0:1790895470.476829:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895470.476835:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476841:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8c1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476920:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c13 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d8c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476929:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:3.0:1790895470.476932:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895470.476936:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c13 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d8c expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.476945:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895470.477011:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741002368:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 642us (793us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1790895470.477018:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 70 00000100:00100000:2.0:1790895470.483744:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895470.484286:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741002496 00000100:00100000:3.0:1790895470.484298:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741002496 00000100:00100000:3.0:1790895470.484360:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 71 00000100:00100000:3.0:1790895470.484370:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741002496:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790895470.484408:0:7639:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790895470.486846:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741002496:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 2465us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895470.486876:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 71 00000100:00100000:3.0:1790895470.494806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895470.495015:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741002752 00000100:00100000:1.0:1790895470.495026:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741002752 00000100:00100000:1.0:1790895470.495087:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 72 00000100:00100000:1.0:1790895470.495097:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741002752:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895470.495120:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895470.495129:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790895470.495154:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8bcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d7e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.495174:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895470.495179:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895470.495193:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8c28 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d93 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790895470.496019:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1790895470.496273:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8c2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.496289:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.496301:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8c2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.496360:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf8c28 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d93 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.496376:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8c2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d93 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.496384:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf314095b00) 00010000:00010000:1.0:1790895470.496387:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895470.496390:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d800, rc 0) 00000100:00100000:1.0:1790895470.496467:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+13:10453:x1877889741002752:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 1370us (1670us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1790895470.496485:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 72 00000100:00100000:3.0:1790895470.503950:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895470.504049:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741003008 00000100:00100000:1.0:1790895470.504060:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741003008 00000100:00100000:1.0:1790895470.504123:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00100000:1.0:1790895470.504134:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+13:10453:x1877889741003008:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790895470.504192:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895470.504215:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf8c2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d93 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.504232:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf314095b00) 00010000:00010000:1.0:1790895470.504244:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895470.504265:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.504278:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.504287:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.504336:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.504344:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.504351:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.504854:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505651:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505659:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505665:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895470.505670:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505678:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505690:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895470.505693:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895470.505698:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505704:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf8c3d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505716:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505722:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505728:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505741:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895470.505744:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505751:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505759:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x366d5826 (ffff8cf314095700) 00010000:00010000:1.0:1790895470.505761:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895470.505765:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.505770:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c44 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x366d5826 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895470.506633:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741003008:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 2496us (2689us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790895470.506642:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00100000:3.0:1790895470.531283:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.536851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741003136 00000100:00100000:0.0:1790895470.537644:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741003136 00000100:00100000:0.0:1790895470.538038:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 74 00000100:00100000:0.0:1790895470.538050:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741003136:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895470.538071:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895470.538092:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8c4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2d9a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.538128:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.538142:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.538153:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.538255:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8c4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.538278:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.538286:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895470.538289:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895470.538292:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895470.538360:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+13:10453:x1877889741003136:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 313us (7087us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895470.538368:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 74 00000100:00100000:3.0:1790895470.546421:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895470.547445:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741003392 00000100:00100000:1.0:1790895470.547932:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741003392 00000100:00100000:1.0:1790895470.548078:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 75 00000100:00100000:1.0:1790895470.548092:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+13:10453:x1877889741003392:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790895470.548208:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.548231:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.548245:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790895470.552409:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1790895470.552434:0:7639:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 343519575585ns, next at 344519571212ns, rc = 0 00000004:00010000:1.0:1790895470.552572:0:7639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a1f4e5b4 reply state 000000009bd88583 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895470.552586:0:7639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895470.552773:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10453:x1877889741003392:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 4677us (6353us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1790895470.552784:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 75 00000100:00100000:1.0:1790895470.582118:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00010000:00010000:0.0:1790895470.583188:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.583216:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.583224:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.583230:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895470.583234:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.583240:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.583258:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895470.583276:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790895470.583282:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.583288:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf8c59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895470.583902:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741003520 00000100:00100000:3.0:1790895470.583917:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741003520 00000100:00100000:3.0:1790895470.583994:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 76 00000100:00100000:3.0:1790895470.584005:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10453:x1877889741003520:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895470.584030:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895470.584048:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2da1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.584123:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.584136:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.584155:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:3.0:1790895470.584158:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790895470.584161:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895470.584803:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10453:x1877889741003520:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 797us (2698us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895470.584811:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 76 00000100:00100000:2.0:1790895470.590710:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.597638:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741003648 00000100:00100000:0.0:1790895470.597653:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741003648 00000100:00100000:0.0:1790895470.597706:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:0.0:1790895470.597714:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2360:x1877889741003648:12345-192.168.201.54@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1790895470.597829:0:6690:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp t0 exp 0000000000000000 cur 343 last 0 00000020:00000080:0.0:1790895470.597950:0:6690:0:(genops.c:1384:class_connect()) connect: client 5979f259-4636-4129-bc0f-4cbabdd61a69, cookie 0x7911a98710cf8c67 00002000:00100000:0.0:1790895470.597973:0:6690:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5979f259-4636-4129-bc0f-4cbabdd61a69/ffff8cf33f9e5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790895470.598000:0:6690:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790895470.598221:0:6690:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790895470.598255:0:6690:0:(import.c:65:import_set_state_nolock()) ffff8cf33f9e6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895470.598419:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2360:x1877889741003648:12345-192.168.201.54@tcp:8:lhsmtool_posix.0 Request processed in 703us (7718us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895470.598427:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:3.0:1790895470.608690:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.611387:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741003776 00000100:00100000:0.0:1790895470.611399:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741003776 00000100:00100000:0.0:1790895470.611707:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:0.0:1790895470.611718:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:0:x1877889741003776:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790895470.613594:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1790895470.698824:0:12000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895470.698834:0:12000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895470.698899:0:12000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790895470.698905:0:12000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:1.0:1790895470.748975:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:1.0:1790895470.748993:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000100:00100000:0.0:1790895470.749197:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:0:x1877889741003776:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 137475us (140509us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1790895470.749218:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:1.0:1790895470.755661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.755788:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741004032 00000100:00100000:0.0:1790895470.755800:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741004032 00000100:00100000:0.0:1790895470.755884:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:0.0:1790895470.755894:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10453:x1877889741004032:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790895470.756268:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10453:x1877889741004032:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 251us (496us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1790895470.756276:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:2.0:1790895470.758667:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895470.761394:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741004288 00000100:00100000:1.0:1790895470.761407:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741004288 00000100:00100000:1.0:1790895470.761470:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 77 00000100:00100000:1.0:1790895470.761479:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10453:x1877889741004288:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790895470.761593:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10453:x1877889741004288:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 115us (2931us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895470.761600:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 77 00000100:00100000:1.0:1790895470.785044:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.787846:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741004416 00000100:00100000:0.0:1790895470.787877:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741004416 00000100:00100000:0.0:1790895470.787934:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:0.0:1790895470.787945:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10453:x1877889741004416:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895470.787977:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895470.787999:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8c6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2da8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.788069:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8c75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.788084:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.788096:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895470.788132:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895470.788150:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8c75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.788177:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8c6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da8 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.788204:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8c75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da8 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.788214:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895470.788217:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790895470.788221:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d600, rc 0) 00000100:00100000:0.0:1790895470.788280:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10453:x1877889741004416:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 338us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895470.788287:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:0.0:1790895470.797671:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895470.798698:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741004544 00000100:00100000:2.0:1790895470.798710:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741004544 00000100:00100000:2.0:1790895470.798892:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:2.0:1790895470.798904:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889741004544:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895470.798924:0:8701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895470.798945:0:8701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2daf expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895470.798985:0:8701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abee56e, blocks: 0x1 00010000:00010000:2.0:1790895470.799006:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=343s v=(0 0) 00010000:00010000:2.0:1790895470.799011:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895470.799029:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 6 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895470.799049:0:8701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 6 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895470.799062:0:8701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84ea00, rc 0) 00000100:00100000:2.0:1790895470.799122:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889741004544:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 221us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895470.799129:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:0.0:1790895470.805989:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895470.808172:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741004800 00000100:00100000:1.0:1790895470.808188:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741004800 00000100:00100000:1.0:1790895470.808259:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 79 00000100:00100000:1.0:1790895470.808270:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10453:x1877889741004800:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1790895470.808393:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10453:x1877889741004800:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 125us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895470.808401:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 79 00000100:00100000:0.0:1790895470.819103:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895470.819188:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741004928 00000100:00100000:1.0:1790895470.819199:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741004928 00000100:00100000:1.0:1790895470.819256:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:1.0:1790895470.819268:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:10453:x1877889741004928:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895470.819286:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895470.819306:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2db6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.819338:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 7 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.819348:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895470.819352:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895470.819357:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.819389:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 7 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.819414:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 7 pid: 8701 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895470.819428:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758852736:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895470.819539:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895470.822020:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.822052:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741005056 00000100:00100000:0.0:1790895470.822060:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741005056 00010000:00010000:0.0:1790895470.822096:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 8 pid: 8701 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895470.822133:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:0.0:1790895470.822143:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306506450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741005056:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895470.822156:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895470.822178:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 8 pid: 8701 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.822203:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 8 pid: 8701 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.822240:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895470.822245:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895470.822254:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.822263:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895470.822297:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895470.822312:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1877889758852864:192.168.201.54@tcp:105: 00000100:00100000:0.0:1790895470.822379:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3060986c0 going to sleep for 11 seconds 00010000:00010000:1.0:1790895470.822695:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ae9784c/0x7911a98710cf8c7c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2daf expref: 8 pid: 8701 timeout: 443 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895470.822738:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758852736:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895470.822759:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895470.822779:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c800, rc 0) 00000100:00100000:1.0:1790895470.822819:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:10453:x1877889741004928:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 3555us (3728us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895470.822827:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:1.0:1790895470.827052:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1877889758852864:192.168.201.54@tcp:105: 00010000:00010000:1.0:1790895470.827078:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895470.827156:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306506450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889741005056:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 5014us (5145us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895470.827168:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:3.0:1790895470.827654:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895470.827938:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741005184 00000100:00100000:3.0:1790895470.827946:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741005184 00002000:00100000:3.0:1790895470.828002:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cf307681f80 x1877889741005184/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:751/0 lens 504/0 e 0 to 0 dl 1790895481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790895470.828019:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf307681f80 with x1877889741005184 ext(0->8) 00002000:00010000:3.0:1790895470.828025:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf307681f80 00000100:00100000:3.0:1790895470.828057:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:3.0:1790895470.828066:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889741005184:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1790895470.828639:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741005184:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 Request processed in 572us (985us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790895470.828647:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00002000:00100000:3.0:1790895470.828655:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8cf307681f80 x1877889741005184/t4294967302(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:751/0 lens 504/448 e 0 to 0 dl 1790895481 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790895470.828664:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf307681f80 with x1877889741005184 ext(0->8) 00002000:00010000:3.0:1790895470.828667:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf307681f80 00000100:00100000:3.0:1790895470.830932:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.831918:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741005312 00000100:00100000:0.0:1790895470.831929:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741005312 00000100:00100000:0.0:1790895470.832039:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 80 00000100:00100000:0.0:1790895470.832050:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10453:x1877889741005312:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1790895470.903659:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10453:x1877889741005312:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 Request processed in 71592us (72719us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895470.903673:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 80 00000001:00080000:0.0:1790895470.903708:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:0.0:1790895470.903717:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:0.0:1790895470.903729:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1790895470.903763:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:0.0:1790895470.903793:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1790895470.903928:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758852992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790895470.903994:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895470.904058:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758852992 00000100:00100000:0.0:1790895470.904067:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758852992 00000100:00100000:0.0:1790895470.904108:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790895470.904118:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758852992:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1790895470.904254:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790895470.904258:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790895471 00002000:00010000:0.0:1790895470.904260:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1790895470.904263:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790895470 -> 1790895471 00002000:00010000:0.0:1790895470.904266:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1790895470.904295:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758852992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 179us (301us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1790895470.904302:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1790895470.904339:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf30fe6dc00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1790895470.904345:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758852992:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790895470.907752:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895470.907905:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741005440 00000100:00100000:3.0:1790895470.907916:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741005440 00000100:00100000:3.0:1790895470.907979:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:3.0:1790895470.907991:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2363:x1877889741005440:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1790895470.962784:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1790895470.962803:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:3.0:1790895470.963146:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889741005440:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 Request processed in 55152us (55398us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895470.963157:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:1.0:1790895470.967616:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895470.967682:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741005696 00000100:00100000:3.0:1790895470.967692:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741005696 00000100:00100000:3.0:1790895470.967760:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 81 00000100:00100000:3.0:1790895470.967772:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+13:10453:x1877889741005696:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790895470.967846:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895470.967906:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8c75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da8 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.967926:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:3.0:1790895470.967931:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895470.967980:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.967995:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.968005:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790895470.968284:0:7639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c0e09bc8 reply state 00000000c1571e16 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895470.968294:0:7639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790895470.968392:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10453:x1877889741005696:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 623us (785us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1790895470.968400:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 81 00010000:00010000:3.0:1790895470.974900:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.974916:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.974924:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.974944:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895470.974959:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.974966:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.974982:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:3.0:1790895470.974985:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895470.974989:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895470.974995:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895470.977639:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895470.977920:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741005824 00000100:00100000:0.0:1790895470.977931:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741005824 00000100:00100000:0.0:1790895470.978001:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:0.0:1790895470.978012:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889741005824:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790895470.978276:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1790895470.978280:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790895471 -> 1790895469 00002000:00010000:0.0:1790895470.978282:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790895468 00002000:00010000:0.0:1790895470.978284:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790895471 -> 1790895469 00002000:00010000:0.0:1790895470.978296:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790895470.978362:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741005824:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 351us (733us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1790895470.978369:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:2.0:1790895470.991386:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895470.992104:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741006080 00000100:00100000:2.0:1790895470.992116:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741006080 00000100:00100000:2.0:1790895470.992178:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 82 00000100:00100000:2.0:1790895470.993931:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+13:10453:x1877889741006080:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1790895470.994019:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895470.994037:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895470.994046:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895470.994080:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895470.994122:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 13 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895470.994138:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf301219180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758853120:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895470.994250:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318c346c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895471.005059:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf301219180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758853120:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895471.005092:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895471.022173:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895471.022304:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741006208 00000100:00100000:3.0:1790895471.022315:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741006208 00010000:00010000:3.0:1790895471.022370:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 14 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895471.022408:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:3.0:1790895471.022419:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+14:2361:x1877889741006208:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895471.022441:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895471.022449:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 14 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.022477:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 14 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.022514:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8c52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d9a expref: 14 pid: 5832 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.022532:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:3.0:1790895471.022538:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.022547:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.022554:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.022578:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895471.022646:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+13:2361:x1877889741006208:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 229us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895471.022654:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00080000:2.0:1790895471.023084:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790895471.023100:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023109:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023140:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023147:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023154:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023160:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895471.023164:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023181:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023202:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:2.0:1790895471.023205:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1790895471.023209:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.023216:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8c91 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895471.023260:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30121b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741006080:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 Request processed in 31073us (31882us total) trans 0 rc -22/-22 00000100:00100000:2.0:1790895471.023267:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 82 00000100:00100000:3.0:1790895471.029404:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895471.029492:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741006336 00000100:00100000:2.0:1790895471.029503:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741006336 00000100:00100000:2.0:1790895471.029558:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:2.0:1790895471.029569:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741006336:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790895471.029612:0:8701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.029633:0:8701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.029642:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895471.029647:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790895471.029651:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.029693:0:8701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.029720:0:8701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 7 pid: 6688 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895471.029735:0:8701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf301218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758853248:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895471.029836:0:8701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318c346c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895471.038332:0:8701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf301218000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758853248:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895471.038361:0:8701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895471.048939:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895471.049388:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741006464 00000100:00100000:3.0:1790895471.049399:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741006464 00010000:00010000:3.0:1790895471.049849:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 8 pid: 6688 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895471.049937:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:3.0:1790895471.049958:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741006464:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895471.049976:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895471.050000:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 8 pid: 6688 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.050028:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 8 pid: 6688 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.050055:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf8c83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2db6 expref: 8 pid: 6688 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.050071:0:11170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(1 0) 00010000:00010000:3.0:1790895471.050076:0:11170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 1) 00010000:00010000:3.0:1790895471.050081:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.050091:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.050120:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895471.050174:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741006464:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 227us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895471.050182:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 44 00010000:00010000:2.0:1790895471.050288:0:8701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.050299:0:8701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.050322:0:8701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.050331:0:8701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.050338:0:8701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.050345:0:8701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ee00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895471.051070:0:8701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.051091:0:8701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.051106:0:8701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.051114:0:8701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf8c98 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895471.051177:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741006336:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 Request processed in 21609us (21780us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895471.052355:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:2.0:1790895471.058815:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895471.058993:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741006720 00000100:00100000:3.0:1790895471.059005:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741006720 00000100:00100000:3.0:1790895471.059065:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 83 00000100:00100000:3.0:1790895471.059076:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+12:10453:x1877889741006720:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790895471.059158:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.059176:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.059201:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.059424:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.059449:0:7639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.059459:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.059494:0:7639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.059524:0:7639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 13 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895471.059539:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758853376:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895471.059629:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3181fad80 going to sleep for 11 seconds 00000100:00100000:3.0:1790895471.063737:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405af480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758853376:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895471.063781:0:7639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895471.066599:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895471.068295:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741006848 00000100:00100000:2.0:1790895471.068311:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741006848 00010000:00010000:2.0:1790895471.068363:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 14 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895471.068401:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:2.0:1790895471.068411:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+14:2362:x1877889741006848:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895471.068427:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895471.068559:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 14 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.068608:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 14 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.068630:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf8c60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2da1 expref: 14 pid: 5831 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.068652:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:2.0:1790895471.068658:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.068667:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.068675:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.068889:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895471.068963:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+13:2362:x1877889741006848:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 553us (2373us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895471.068972:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 45 00010000:00010000:3.0:1790895471.071403:0:7639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895471.071420:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790895471.072172:0:7639:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1790895471.072623:0:7639:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1790895471.073086:0:7639:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1790895471.073259:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7639:1877889758853504:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790895471.073391:0:7639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895471.073462:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306737000 going to sleep for 11 seconds 00000100:00100000:2.0:1790895471.073628:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758853504 00000100:00100000:2.0:1790895471.073637:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758853504 00000100:00100000:2.0:1790895471.073748:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790895471.073759:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7639:x1877889758853504:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790895471.074169:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7639:x1877889758853504:12345-0@lo:1000:mdt00_003.0 Request processed in 411us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895471.074177:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895471.074510:0:7639:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1790895471.074517:0:7639:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf30fe6dc00, transno 4294967303 00000100:00100000:0.0:1790895471.074629:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405ace00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7639:1877889758853504:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1790895471.075504:0:7639:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1790895471.075589:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7639:1877889758853632:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790895471.075636:0:7639:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1790895471.075730:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895471.076159:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303098c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895471.077172:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758853632 00000100:00100000:2.0:1790895471.077242:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758853632 00000100:00100000:3.0:1790895471.077422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790895471.077431:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7639:x1877889758853632:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1790895471.077734:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7639:x1877889758853632:12345-0@lo:1000:mdt00_003.0 Request processed in 303us (2097us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790895471.077748:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790895471.077890:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7639:1877889758853632:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1790895471.077924:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.077935:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.077942:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.077962:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895471.077967:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.077975:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.077991:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895471.078003:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895471.078008:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078014:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf8ca6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078054:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078061:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078067:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078072:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895471.078075:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078080:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078088:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:0.0:1790895471.078091:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895471.078094:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078100:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf8bd4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078138:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078160:0:7639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078169:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078410:0:7639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.078445:0:7639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 16 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895471.078459:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758853760:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895471.078535:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3181faf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895471.084160:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895471.084304:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741006976 00000100:00100000:1.0:1790895471.084325:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741006976 00010000:00010000:1.0:1790895471.084368:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 17 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895471.084407:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:1.0:1790895471.084417:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:2361:x1877889741006976:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895471.084615:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895471.084624:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 17 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.084651:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 17 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.084674:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:1.0:1790895471.084696:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.084707:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.084715:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.084736:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895471.085005:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:2361:x1877889741006976:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 587us (855us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895471.085014:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 46 00010000:00010000:0.0:1790895471.085451:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8bf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2d85 expref: 16 pid: 5833 timeout: 444 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895471.085469:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758853760:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895471.085488:0:7639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085498:0:7639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085504:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085516:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085643:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085650:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085657:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895471.085661:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085669:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.085688:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:0.0:1790895471.088699:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895471.088711:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.088723:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8cad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.088754:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.088761:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.089036:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.089044:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895471.089067:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.089075:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.089090:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf314095e00) 00010000:00010000:0.0:1790895471.089093:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895471.089097:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895471.089102:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8c9f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895471.089383:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10453:x1877889741006720:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 30305us (30577us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1790895471.089394:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 83 00000020:00080000:0.0:1790895471.089400:0:7639:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1790895471.089581:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895471.089586:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895471.089612:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790895471.089617:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790895471.094620:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895471.095177:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741007232 00000100:00100000:1.0:1790895471.095260:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741007232 00000100:00100000:1.0:1790895471.095355:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:1.0:1790895471.095366:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10453:x1877889741007232:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1790895471.096669:0:5835:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1790895471.097079:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1790895471.097144:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.097170:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.097182:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.097191:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.097197:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.097203:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895471.097232:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895471.097481:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895471.097488:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.097496:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895471.097500:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.097509:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.097521:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8cf310cb5b00) 00010000:00010000:2.0:1790895471.097525:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1790895471.097537:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.097544:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf8cb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895471.097560:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895471.097562:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895471.097564:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895471.098005:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10453:x1877889741007232:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 2637us (3391us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1790895471.098016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00000020:00080000:1.0:1790895471.098022:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790895471.323188:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895472.345117:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790895472.365295:0:12052:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790895472.365305:0:12052:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790895472.365342:0:12052:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1790895472.365347:0:12052:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790895472.439755:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.440139:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741007488 00000100:00100000:2.0:1790895472.440151:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741007488 00000100:00100000:2.0:1790895472.440215:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:2.0:1790895472.440227:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:10471:x1877889741007488:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895472.440260:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895472.440280:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8cbb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2dbd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.440373:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8cc2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.440388:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.440400:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8cc2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895472.440409:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1790895472.440521:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8cbb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dbd expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.440537:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8cc2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dbd expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.440545:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895472.440548:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790895472.440552:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f800, rc 0) 00000100:00100000:2.0:1790895472.440612:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10471:x1877889741007488:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 386us (867us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1790895472.440620:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:1.0:1790895472.443382:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.443468:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741007616 00000100:00100000:3.0:1790895472.443478:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741007616 00000100:00100000:3.0:1790895472.443562:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 85 00000100:00100000:3.0:1790895472.443572:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10471:x1877889741007616:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:3.0:1790895472.443642:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.443666:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.443677:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.443691:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.443698:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.443705:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444328:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444338:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444346:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790895472.444385:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444397:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444404:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444419:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444425:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.444430:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444438:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444451:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:3.0:1790895472.444454:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.444460:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444466:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8cd0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444477:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444483:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444489:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444494:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.444497:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444512:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444519:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf3183e2300) 00010000:00010000:3.0:1790895472.444521:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.444524:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444531:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8cd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444545:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444551:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444557:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444563:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.444566:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444572:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444579:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf3183e2c00) 00010000:00010000:3.0:1790895472.444581:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.444584:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.444597:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8cde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.444732:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10471:x1877889741007616:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 1160us (1356us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.444740:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 85 00000100:00100000:0.0:1790895472.467210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.467250:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741007872 00000100:00100000:2.0:1790895472.467259:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741007872 00000100:00100000:2.0:1790895472.467354:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 86 00000100:00100000:2.0:1790895472.467369:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10474:x1877889741007872:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895472.467387:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895472.467404:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8ce5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2dc4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467464:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467474:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467483:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467495:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467500:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467504:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467738:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467744:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467749:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895472.467762:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1790895472.467831:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467836:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467840:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467844:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895472.467847:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467851:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467898:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895472.467900:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895472.467903:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467908:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8cec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467914:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467919:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467945:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467948:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895472.467950:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467954:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467959:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf310c7e700) 00010000:00010000:2.0:1790895472.467960:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895472.467962:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.467966:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8cf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.468004:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8ce5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.468018:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.468026:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:2.0:1790895472.468028:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895472.468031:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84ec00, rc 0) 00000100:00100000:2.0:1790895472.468097:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+21:10474:x1877889741007872:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 730us (894us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1790895472.468108:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 86 00000100:00100000:1.0:1790895472.473581:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.473782:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741008000 00000100:00100000:3.0:1790895472.473792:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741008000 00000100:00100000:3.0:1790895472.473845:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 87 00000100:00100000:3.0:1790895472.473892:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+21:10474:x1877889741008000:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:3.0:1790895472.474371:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474390:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474403:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474805:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474813:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474820:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474826:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.474830:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474843:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474855:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:3.0:1790895472.474881:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895472.474886:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.474893:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.475219:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+21:10474:x1877889741008000:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 1303us (1587us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.475230:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 87 00000100:00100000:2.0:1790895472.476705:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.476765:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741008256 00000100:00100000:0.0:1790895472.476774:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741008256 00000100:00100000:0.0:1790895472.476842:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:0.0:1790895472.476851:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+21:10474:x1877889741008256:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:0.0:1790895472.477099:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+22:10474:x1877889741008256:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 249us (397us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1790895472.477115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:3.0:1790895472.497775:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.498759:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741008512 00000100:00100000:2.0:1790895472.498772:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741008512 00000100:00100000:2.0:1790895472.498835:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 88 00000100:00100000:2.0:1790895472.498847:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+22:9996:x1877889741008512:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895472.498900:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895472.498932:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8d0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2dcb expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.499033:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.499047:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.499057:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.499090:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.499115:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 23 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.499129:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf301218000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758853888:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895472.499220:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b000 going to sleep for 11 seconds 00000100:00100000:0.0:1790895472.508817:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.508822:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf301218000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758853888:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895472.508881:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.509073:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741008640 00000100:00100000:3.0:1790895472.509079:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741008640 00010000:00010000:3.0:1790895472.509108:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 24 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.509138:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:3.0:1790895472.509146:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+24:2362:x1877889741008640:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895472.509168:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895472.509174:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 24 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.509197:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 24 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.509231:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8cfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dc4 expref: 24 pid: 5833 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.509244:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:3.0:1790895472.509247:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.509253:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.509259:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.509278:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895472.509335:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.509344:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895472.509367:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:3.0:1790895472.509457:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+23:2362:x1877889741008640:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 310us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.509465:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00010000:00010000:2.0:1790895472.509554:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8d0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.509572:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 23 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.509580:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:2.0:1790895472.509583:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790895472.509586:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f400, rc 0) 00000100:00100000:2.0:1790895472.509624:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+23:9996:x1877889741008512:12345-192.168.201.54@tcp:101:bash.0 Request processed in 10780us (11858us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1790895472.509631:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 88 00000100:00100000:0.0:1790895472.511801:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.511958:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741008896 00000100:00100000:2.0:1790895472.511969:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741008896 00000100:00100000:2.0:1790895472.512063:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 89 00000100:00100000:2.0:1790895472.512076:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+23:9996:x1877889741008896:12345-192.168.201.54@tcp:36:bash.0 00010000:00010000:2.0:1790895472.512330:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.512358:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.512369:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790895472.512420:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1790895472.512458:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000432afcf reply state 00000000ada1d239 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.512467:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1790895472.512511:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1790895472.515601:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+27:9996:x1877889741008896:12345-192.168.201.54@tcp:36:bash.0 Request processed in 3519us (3799us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1790895472.515613:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 89 00000020:00080000:2.0:1790895472.515620:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1790895472.518734:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.518752:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.518759:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.518765:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.518770:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.518777:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.518794:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:0.0:1790895472.518798:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895472.518802:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.518808:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8d24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.519153:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.519210:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009024 00000100:00100000:3.0:1790895472.519221:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009024 00000100:00100000:3.0:1790895472.519312:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 90 00000100:00100000:3.0:1790895472.519322:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+26:9996:x1877889741009024:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895472.519345:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895472.519363:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2dd2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.519428:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd2 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.519460:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd2 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.519481:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:3.0:1790895472.519484:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790895472.519486:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ce00, rc 0) 00000100:00100000:3.0:1790895472.519544:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+27:9996:x1877889741009024:12345-192.168.201.54@tcp:101:bash.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.519551:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 90 00000100:00100000:3.0:1790895472.521703:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.521740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.521747:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009280 00000100:00100000:0.0:1790895472.521757:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009280 00000100:00100000:3.0:1790895472.521768:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.521788:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.521806:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.521814:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009408 00000100:00080000:3.0:1790895472.521821:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895472.521829:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009408 00000100:00100000:3.0:1790895472.521832:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009664 00000100:00100000:3.0:1790895472.521836:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009664 00000100:00100000:3.0:1790895472.521878:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:3.0:1790895472.521889:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741009280:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895472.521911:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009152 00000100:00100000:2.0:1790895472.521917:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009152 00000100:00100000:2.0:1790895472.521967:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 284 00000100:00100000:3.0:1790895472.521969:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741009280:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 80us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.521978:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741009152:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895472.521981:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:3.0:1790895472.522004:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:3.0:1790895472.522016:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741009408:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895472.522016:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741009152:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 38us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.522030:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 284 00000100:00100000:3.0:1790895472.522059:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741009408:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 47us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.522069:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:3.0:1790895472.522079:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:2.0:1790895472.522082:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:9996:x1877889741009664:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895472.522097:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1790895472.522099:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1790895472.522119:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2dd9 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895472.522153:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abee56d, atime: 0x6abee56c, ctime: 0x6abee56d, blocks: 0xb 00010000:00010000:2.0:1790895472.522172:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:2.0:1790895472.522177:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895472.522184:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.522203:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.522215:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f600, rc 0) 00000100:00100000:2.0:1790895472.522261:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:9996:x1877889741009664:12345-192.168.201.54@tcp:101:bash.0 Request processed in 174us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.522268:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:1.0:1790895472.522393:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009536 00000100:00100000:1.0:1790895472.522398:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009536 00000100:00100000:1.0:1790895472.522514:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 128 00000100:00100000:1.0:1790895472.522523:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889741009536:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895472.522562:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889741009536:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 41us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895472.522569:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 128 00000100:00080000:2.0:1790895472.522832:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895472.526836:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.527110:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009792 00000100:00100000:0.0:1790895472.527122:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009792 00002000:00010000:0.0:1790895472.527167:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1790895472.527172:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3405af100 with x1877889741009792 ext(0->18446744073709551615) 00002000:00010000:0.0:1790895472.527183:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf3405af100. 00000100:00100000:0.0:1790895472.527210:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:0.0:1790895472.527218:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741009792:12345-192.168.201.54@tcp:10:bash.0 00002000:00010000:0.0:1790895472.527538:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790895472.527542:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1790895469 -> 1790895472 00002000:00010000:0.0:1790895472.527544:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1790895468 -> 1790895468 00002000:00010000:0.0:1790895472.527546:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1790895469 -> 1790895472 00002000:00010000:0.0:1790895472.527549:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790895472.527668:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741009792:12345-192.168.201.54@tcp:10:bash.0 Request processed in 451us (847us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1790895472.527674:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00002000:00010000:0.0:1790895472.527677:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1790895472.527679:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3405af100 with x1877889741009792 ext(0->18446744073709551615) 00002000:00010000:0.0:1790895472.527683:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf3405af100. 00000100:00100000:3.0:1790895472.560996:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.561102:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741009920 00000100:00100000:0.0:1790895472.561114:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741009920 00000100:00100000:0.0:1790895472.561177:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 91 00000100:00100000:0.0:1790895472.561188:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10489:x1877889741009920:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:0.0:1790895472.561263:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561282:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561308:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561325:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561332:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561338:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561564:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561574:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561581:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895472.561619:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561630:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561637:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561644:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561659:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.561663:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561670:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561681:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895472.561684:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895472.561689:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561695:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d39 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561706:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561712:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561717:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561722:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.561725:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561731:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561746:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf31037c100) 00010000:00010000:0.0:1790895472.561748:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895472.561751:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561757:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561770:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561775:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561781:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561786:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.561789:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561794:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561801:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:0.0:1790895472.561803:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895472.561805:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.561810:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.562043:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10489:x1877889741009920:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 856us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895472.562051:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 91 00000100:00100000:2.0:1790895472.588824:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895472.588906:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741010176 00000100:00100000:1.0:1790895472.588934:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741010176 00000100:00100000:2.0:1790895472.589102:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 92 00000100:00100000:2.0:1790895472.589113:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10492:x1877889741010176:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895472.589133:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895472.589154:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8d4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2de0 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589219:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589233:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589256:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589270:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589277:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589283:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589513:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8d63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589523:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.589530:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8d63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895472.589539:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1790895472.590906:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.590927:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.590934:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.590940:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84fa00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895472.590953:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.590961:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591187:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895472.591191:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895472.591197:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591203:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8d55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591217:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591222:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591228:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591232:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84fe00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895472.591235:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591240:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591247:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf310c7ee00) 00010000:00010000:2.0:1790895472.591249:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895472.591259:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591265:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8d5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591315:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8d4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2de0 expref: 30 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591329:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8d63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2de0 expref: 29 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.591336:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:2.0:1790895472.591338:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1790895472.591341:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e400, rc 0) 00000100:00100000:2.0:1790895472.591469:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+29:10492:x1877889741010176:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 2357us (2653us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1790895472.591478:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 92 00000100:00100000:2.0:1790895472.595104:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.595160:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741010304 00000100:00100000:3.0:1790895472.595172:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741010304 00000100:00100000:3.0:1790895472.595233:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 93 00000100:00100000:3.0:1790895472.595243:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+29:10492:x1877889741010304:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:3.0:1790895472.595307:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.595324:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.595334:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.595438:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.595466:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 29 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.595481:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758854016:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895472.595569:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3052a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895472.597791:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895472.597852:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741010560 00000100:00100000:1.0:1790895472.597898:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741010560 00000100:00100000:1.0:1790895472.597976:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:1.0:1790895472.597989:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+30:6061:x1877889741010560:12345-192.168.201.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790895472.598057:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758854016:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895472.598082:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895472.598347:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+31:6061:x1877889741010560:12345-192.168.201.54@tcp:35:ldlm_bl.0 Request processed in 361us (562us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1790895472.598354:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:2.0:1790895472.599830:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895472.599974:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741010688 00000100:00100000:1.0:1790895472.599984:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741010688 00010000:00010000:1.0:1790895472.600034:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 31 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895472.600449:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:1.0:1790895472.600459:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+31:2361:x1877889741010688:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895472.600485:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895472.600493:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 31 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.600519:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 31 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.600563:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8d16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dcb expref: 31 pid: 5831 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.600577:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:1.0:1790895472.600582:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.600592:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.600599:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.600634:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895472.600659:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.600674:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895472.600699:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340632d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+30:2361:x1877889741010688:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 240us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895472.600712:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 48 00010000:00010000:0.0:1790895472.600899:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.600909:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.600917:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.600935:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.600940:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.600948:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.600959:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:0.0:1790895472.600963:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895472.600968:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.600975:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8d71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.601034:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340633100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+29:10492:x1877889741010304:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 5792us (5938us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895472.601043:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 93 00000100:00100000:2.0:1790895472.602466:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.602545:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741010944 00000100:00100000:3.0:1790895472.602553:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741010944 00000100:00100000:3.0:1790895472.602594:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:3.0:1790895472.602604:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+29:10492:x1877889741010944:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:3.0:1790895472.602811:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+30:10492:x1877889741010944:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 208us (348us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1790895472.602819:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:2.0:1790895472.648961:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.649112:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741011200 00000100:00100000:0.0:1790895472.649123:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741011200 00000100:00100000:0.0:1790895472.649190:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 94 00000100:00100000:0.0:1790895472.649201:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+30:10503:x1877889741011200:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:0.0:1790895472.649226:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895472.649246:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2de7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649317:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649332:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649345:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649360:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649368:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649375:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649632:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8d8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649643:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649664:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8d8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895472.649675:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1790895472.649767:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649775:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649783:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649789:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.649794:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649803:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649816:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895472.649820:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895472.649826:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649832:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8d7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649845:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649852:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649927:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649934:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.649937:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649943:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649952:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf31037c900) 00010000:00010000:0.0:1790895472.649955:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895472.649958:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.649963:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.650019:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2de7 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.650034:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8d8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2de7 expref: 32 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.650041:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:0.0:1790895472.650043:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895472.650045:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d800, rc 0) 00000100:00100000:0.0:1790895472.650116:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+32:10503:x1877889741011200:12345-192.168.201.54@tcp:101:cat.0 Request processed in 916us (1165us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1790895472.650134:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 94 00000100:00100000:1.0:1790895472.655371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.658126:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741011456 00000100:00100000:2.0:1790895472.658146:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741011456 00000100:00100000:2.0:1790895472.658312:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:2.0:1790895472.658360:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+32:10503:x1877889741011456:12345-192.168.201.54@tcp:35:cat.0 00000100:00100000:2.0:1790895472.658626:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+33:10503:x1877889741011456:12345-192.168.201.54@tcp:35:cat.0 Request processed in 278us (3278us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1790895472.658634:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:2.0:1790895472.679183:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.679251:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741011712 00000100:00100000:0.0:1790895472.679262:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741011712 00000100:00100000:0.0:1790895472.679644:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 95 00000100:00100000:0.0:1790895472.679656:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+33:10504:x1877889741011712:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:0.0:1790895472.679722:0:5831:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790895472.679747:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8d8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2de7 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679768:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8d63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2de0 expref: 32 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679780:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd2 expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679791:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:0.0:1790895472.679801:0:5831:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895472.679819:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679831:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679840:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679853:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679914:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.679935:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680151:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680170:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680177:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790895472.680638:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1790895472.680646:0:5831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 345647787778ns, next at 346647785843ns, rc = 0 00010000:00010000:0.0:1790895472.680695:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680703:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680711:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680719:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680725:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680740:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680767:0:5831:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790895472.680787:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680793:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680799:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680804:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.680809:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680816:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680825:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:0.0:1790895472.680827:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790895472.680831:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680837:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8da9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680853:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.680878:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895472.680886:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.680887:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680903:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.680908:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895472.680911:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.680925:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680927:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.680948:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680948:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680963:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895472.680966:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.680969:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:0.0:1790895472.680970:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.680976:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790895472.680983:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.680984:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8d9b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.681003:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8db0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895472.681005:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055facf87 reply state 00000000090d9ca1 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.681017:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790895472.681040:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895472.681042:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895472.681044:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895472.681095:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+32:10504:x1877889741011712:12345-192.168.201.54@tcp:36:rm.0 Request processed in 1441us (1919us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1790895472.681102:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 95 00010000:00010000:3.0:1790895472.682770:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.682786:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.682794:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.682800:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.682803:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.682811:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.682824:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf31037c900) 00010000:00010000:3.0:1790895472.682827:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.682831:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.682836:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8da2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.720362:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.723605:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741011968 00000100:00100000:0.0:1790895472.723622:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741011968 00000100:00100000:0.0:1790895472.723747:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 96 00000100:00100000:0.0:1790895472.723758:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+31:10510:x1877889741011968:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895472.723802:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895472.723823:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8db7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2dee expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.724293:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.724310:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.724322:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.724339:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.724345:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.724352:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790895472.725702:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:0.0:1790895472.726662:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726682:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726693:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726752:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726760:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726767:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726773:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895472.726777:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726785:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726797:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895472.726800:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895472.726805:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.726812:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8dbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895472.726826:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c91a20a reply state 0000000007fbd5f4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.726835:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1790895472.727726:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8db7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 34 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.727767:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.727775:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:0.0:1790895472.727778:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895472.727782:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895472.727889:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+34:10510:x1877889741011968:12345-192.168.201.54@tcp:101:bash.0 Request processed in 4132us (7536us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1790895472.727898:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 96 00010000:00010000:3.0:1790895472.731466:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.731485:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.731516:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.731524:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.731529:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.731537:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.731555:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf31037cf00) 00010000:00010000:3.0:1790895472.731558:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.731563:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.731568:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8dc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.733104:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.733312:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741012096 00000100:00100000:3.0:1790895472.733323:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741012096 00000100:00100000:3.0:1790895472.733381:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:3.0:1790895472.733392:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741012096:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895472.733410:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895472.733432:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2df5 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895472.733456:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895472.733475:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=345s v=(0 0) 00010000:00010000:3.0:1790895472.733486:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895472.733495:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.733588:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.733602:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167da00, rc 0) 00000100:00100000:3.0:1790895472.733663:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741012096:12345-192.168.201.54@tcp:101:bash.0 Request processed in 273us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.733670:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:2.0:1790895472.739311:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.739409:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741012224 00000100:00100000:0.0:1790895472.739419:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741012224 00000100:00100000:0.0:1790895472.739520:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:0.0:1790895472.739531:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+8:10510:x1877889741012224:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895472.739549:0:8701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895472.739567:0:8701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2dfc expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.739597:0:8701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.739605:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895472.739609:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895472.739614:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 9 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.739663:0:8701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 9 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.739688:0:8701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 9 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.739700:0:8701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8701:1877889758854144:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895472.739786:0:8701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305962900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895472.741744:0:8701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8701:1877889758854144:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895472.741773:0:8701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 9 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.741794:0:8701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7ca00, rc 0) 00000100:00100000:2.0:1790895472.741850:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+9:10510:x1877889741012224:12345-192.168.201.54@tcp:101:bash.0 Request processed in 2320us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.741886:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:1.0:1790895472.742616:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.742692:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741012352 00000100:00100000:2.0:1790895472.742702:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741012352 00010000:00010000:2.0:1790895472.742736:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 9 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.742768:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:2.0:1790895472.742777:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306505c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2362:x1877889741012352:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895472.742791:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895472.742814:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 9 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.742852:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 9 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.742896:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf8dda lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2df5 expref: 9 pid: 6691 timeout: 445 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.742912:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895472.742926:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895472.742934:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 8 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.742945:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 8 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.743592:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 8 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.743604:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5818:1877889758854272:192.168.201.54@tcp:105: 00000100:00100000:2.0:1790895472.743670:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908b000 going to sleep for 11 seconds 00000100:00100000:2.0:1790895472.746262:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405a2680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5818:1877889758854272:192.168.201.54@tcp:105: 00010000:00010000:2.0:1790895472.746288:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895472.746340:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306505c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741012352:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 3563us (3724us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.746350:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:1.0:1790895472.746727:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.746754:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741012608 00000100:00100000:0.0:1790895472.746761:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741012608 00000100:00100000:0.0:1790895472.746798:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:0.0:1790895472.746808:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+33:10510:x1877889741012608:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:0.0:1790895472.747616:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+34:10510:x1877889741012608:12345-192.168.201.54@tcp:35:bash.0 Request processed in 803us (884us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1790895472.747624:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:0.0:1790895472.850084:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.850194:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741012736 00000100:00100000:2.0:1790895472.850204:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741012736 00000100:00100000:2.0:1790895472.850263:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 97 00000100:00100000:2.0:1790895472.850274:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+34:10526:x1877889741012736:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895472.850298:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895472.850318:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8de8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e03 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.850390:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8def lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.850404:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.850416:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895472.850456:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1790895472.850461:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895472.850479:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8def lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.850503:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8de8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e03 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.850521:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8def lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e03 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.850528:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895472.850530:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895472.850545:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e800, rc 0) 00000100:00100000:2.0:1790895472.850603:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+35:10526:x1877889741012736:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 331us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.850610:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 97 00000100:00100000:3.0:1790895472.852895:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.853101:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741012992 00000100:00100000:2.0:1790895472.853112:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741012992 00000100:00100000:2.0:1790895472.853248:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 98 00000100:00100000:2.0:1790895472.853258:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+35:10526:x1877889741012992:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895472.853276:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895472.853295:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8df6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e0a expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.853644:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8dfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.853658:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.853671:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8dfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895472.853683:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790895472.853814:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8df6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e0a expref: 38 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.853830:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8dfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e0a expref: 37 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.853840:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:2.0:1790895472.853854:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895472.853882:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e000, rc 0) 00000100:00100000:2.0:1790895472.853960:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+37:10526:x1877889741012992:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 703us (1074us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1790895472.853967:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 98 00000100:00100000:1.0:1790895472.857279:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895472.857310:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.857370:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741013376 00000100:00100000:3.0:1790895472.857378:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741013376 00000100:00100000:3.0:1790895472.857432:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:3.0:1790895472.857439:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+37:2362:x1877889741013376:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895472.857450:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895472.857468:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8dfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e0a expref: 37 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.857482:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:3.0:1790895472.857485:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895472.857524:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+36:2362:x1877889741013376:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 86us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.857529:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:0.0:1790895472.857681:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741013248 00000100:00100000:0.0:1790895472.857684:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741013248 00000100:00100000:0.0:1790895472.857721:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 99 00000100:00100000:0.0:1790895472.857730:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+36:10526:x1877889741013248:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895472.857748:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895472.857760:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e11 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.857842:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8e12 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.857852:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.857893:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8e12 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895472.857901:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1790895472.858028:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e11 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.858342:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e11 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.858565:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:0.0:1790895472.858569:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790895472.858572:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895472.858623:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+38:10526:x1877889741013248:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 893us (1350us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1790895472.858630:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 99 00000100:00100000:2.0:1790895472.862854:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.863068:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741013504 00000100:00100000:3.0:1790895472.863091:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741013504 00000100:00100000:3.0:1790895472.863151:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:3.0:1790895472.863464:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2364:x1877889741013504:12345-192.168.201.54@tcp:1:lfs.0 00010000:00010000:3.0:1790895472.863502:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.863516:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 8 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.863521:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895472.863524:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790895472.863528:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.863552:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 8 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.863576:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 8 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.863590:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758854400:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895472.864106:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3052a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1790895472.866569:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405ad180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758854400:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895472.866598:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.866612:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.866657:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741013632 00000100:00100000:3.0:1790895472.866663:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741013632 00002000:00100000:3.0:1790895472.866697:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cf3405a0000 x1877889741013632/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:753/0 lens 504/0 e 0 to 0 dl 1790895483 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790895472.866704:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3405a0000 with x1877889741013632 ext(0->8) 00010000:00010000:3.0:1790895472.866719:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 9 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.866739:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 9 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895472.866745:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf3405a0000 00000100:00100000:3.0:1790895472.866766:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:3.0:1790895472.866772:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2362:x1877889741013632:12345-192.168.201.54@tcp:4:lfs.0 00000100:00100000:3.0:1790895472.867175:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:2362:x1877889741013632:12345-192.168.201.54@tcp:4:lfs.0 Request processed in 393us (553us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1790895472.867183:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00002000:00100000:3.0:1790895472.867190:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8cf3405a0000 x1877889741013632/t4294967302(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:753/0 lens 504/448 e 0 to 0 dl 1790895483 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790895472.867198:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3405a0000 with x1877889741013632 ext(0->8) 00010000:00010000:3.0:1790895472.867203:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 11 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.867217:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 11 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895472.867224:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf3405a0000 00000100:00100000:3.0:1790895472.868687:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.868770:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741013760 00000100:00100000:0.0:1790895472.868789:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741013760 00010000:00010000:0.0:1790895472.868823:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 11 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.868898:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:0.0:1790895472.868958:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:2362:x1877889741013760:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895472.869022:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790895472.869038:0:5817:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790895472.869040:0:5817:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1790895473 00002000:00010000:0.0:1790895472.869042:0:5817:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1790895473 00002000:00010000:0.0:1790895472.869043:0:5817:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1790895473 00010000:00010000:0.0:1790895472.869047:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 11 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.869065:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 11 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.869083:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003644fe09/0x7911a98710cf8de1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dfc expref: 11 pid: 8701 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.869096:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895472.869099:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895472.869103:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.869110:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.869232:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895472.869271:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2362:x1877889741013760:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 364us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895472.869278:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 50 00010000:00010000:3.0:1790895472.870443:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870474:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870503:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870511:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870521:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870527:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167dc00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895472.870532:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870540:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870555:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.870562:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf8e20 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.870646:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2364:x1877889741013504:12345-192.168.201.54@tcp:1:lfs.0 Request processed in 7184us (7800us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.870654:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:3.0:1790895472.873080:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895472.873238:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741014016 00000100:00100000:2.0:1790895472.873247:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741014016 00000100:00100000:2.0:1790895472.873293:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:2.0:1790895472.873303:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+38:10526:x1877889741014016:12345-192.168.201.54@tcp:35:lfs.0 00000004:00010000:2.0:1790895472.873367:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8e12 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e11 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790895472.873609:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1790895472.873636:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1790895472.874017:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1790895472.874065:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.874077:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.874084:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.874114:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895472.874209:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 42 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895472.874221:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1877889758854528:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895472.874293:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895472.876946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.877111:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741014144 00000100:00100000:0.0:1790895472.877123:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741014144 00010000:00010000:0.0:1790895472.877161:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 43 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895472.877198:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:0.0:1790895472.877208:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+43:2361:x1877889741014144:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895472.877222:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895472.877228:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 43 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.877254:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 43 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.877275:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:0.0:1790895472.877281:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.877290:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.877298:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.877328:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895472.877492:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+43:2361:x1877889741014144:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 285us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895472.877500:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 51 00010000:00010000:1.0:1790895472.877617:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf8dcc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dee expref: 42 pid: 5832 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895472.877633:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1877889758854528:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895472.877655:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.877669:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.877675:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895472.877798:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1790895472.878195:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1790895472.878307:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758854656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790895472.878457:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895472.878489:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895472.878505:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758854656 00000100:00100000:2.0:1790895472.878511:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758854656 00000100:00100000:2.0:1790895472.878580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790895472.878589:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1877889758854656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790895472.878658:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5835:x1877889758854656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 70us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895472.878665:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1790895472.878680:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758854656:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:3.0:1790895472.878803:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1790895472.879191:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1790895472.879236:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c20000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758854784:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790895472.879258:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895472.879276:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895472.879298:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758854784 00000100:00100000:3.0:1790895472.879302:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758854784 00000100:00100000:3.0:1790895472.879335:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790895472.879342:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5835:x1877889758854784:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790895472.879490:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5835:x1877889758854784:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 148us (230us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1790895472.879497:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790895472.879520:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c20000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758854784:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790895472.879558:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1790895472.879589:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.879599:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.879605:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.879610:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895472.879621:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.879629:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.879641:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:1.0:1790895472.879644:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790895472.879648:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895472.879654:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8e27 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790895472.879801:0:5835:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790895472.879946:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1790895472.879957:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 345847098384ns, next at 346847096509ns, rc = 0 00000001:00080000:1.0:1790895472.879964:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1790895472.880044:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:1.0:1790895472.880047:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790895472.880052:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf8e12 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e11 expref: 46 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895472.880122:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+45:10526:x1877889741014016:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 6821us (7050us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1790895472.880130:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 26 00000020:00080000:1.0:1790895472.880134:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1790895472.881759:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.881802:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741014272 00000100:00100000:0.0:1790895472.881810:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741014272 00000100:00100000:0.0:1790895472.881851:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 100 00000100:00100000:0.0:1790895472.881898:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+45:10526:x1877889741014272:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895472.881928:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895472.881949:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8e2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e18 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.882131:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8e2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e18 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.882143:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8e2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e18 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895472.882205:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895472.882208:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895472.882211:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7ca00, rc 0) 00000100:00100000:0.0:1790895472.882252:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+46:10526:x1877889741014272:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 393us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895472.882259:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 100 00000100:00100000:2.0:1790895472.884165:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895472.884221:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741014528 00000100:00100000:0.0:1790895472.884229:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741014528 00000100:00100000:0.0:1790895472.884301:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:0.0:1790895472.884308:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+46:10526:x1877889741014528:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:0.0:1790895472.884511:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+47:10526:x1877889741014528:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 199us (347us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1790895472.884519:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:2.0:1790895472.940023:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895472.940168:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741014656 00000100:00100000:3.0:1790895472.940182:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741014656 00000100:00100000:3.0:1790895472.940236:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 101 00000100:00100000:3.0:1790895472.940244:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+47:10536:x1877889741014656:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:3.0:1790895472.940317:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940334:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940358:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940396:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940402:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940415:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940496:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940502:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940506:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790895472.940542:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940551:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940555:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940564:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940570:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167dc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.940574:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940587:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940607:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:3.0:1790895472.940610:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.940615:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940627:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8e35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940648:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940659:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940665:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940670:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.940672:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940678:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940689:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf3183e2c00) 00010000:00010000:3.0:1790895472.940693:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.940695:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940717:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940734:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940746:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940752:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940758:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895472.940761:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940767:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940781:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:3.0:1790895472.940783:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895472.940786:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895472.940791:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8e43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895472.941110:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+47:10536:x1877889741014656:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 865us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895472.941120:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 101 00000100:00100000:3.0:1790895472.999931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.000095:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741014912 00000100:00100000:2.0:1790895473.000106:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741014912 00000100:00100000:2.0:1790895473.000169:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 102 00000100:00100000:2.0:1790895473.000180:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+47:10539:x1877889741014912:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895473.000206:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895473.000228:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e1f expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000305:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000319:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000653:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000670:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000724:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000734:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000847:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000853:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.000936:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895473.000945:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790895473.001035:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001043:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001049:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001055:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895473.001067:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001074:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001088:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895473.001091:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895473.001096:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001103:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8e51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001117:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001123:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001128:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001133:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ec00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895473.001136:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001142:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001209:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf310c7ee00) 00010000:00010000:2.0:1790895473.001212:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895473.001222:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001228:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001270:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 50 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001281:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 49 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.001286:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895473.001288:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895473.001290:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f200, rc 0) 00000100:00100000:2.0:1790895473.001597:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+49:10539:x1877889741014912:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1418us (1685us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1790895473.001605:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 102 00000100:00100000:2.0:1790895473.004569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895473.005274:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741015040 00000100:00100000:0.0:1790895473.005285:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741015040 00000100:00100000:0.0:1790895473.005370:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 103 00000100:00100000:0.0:1790895473.005381:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+49:10539:x1877889741015040:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:0.0:1790895473.005445:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005462:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005475:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1790895473.005493:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895473.005513:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005522:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005528:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005534:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895473.005539:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005575:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005587:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895473.005591:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895473.005596:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.005603:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895473.005678:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+49:10539:x1877889741015040:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 298us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895473.005686:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 103 00000100:00100000:1.0:1790895473.007639:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.007725:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741015296 00000100:00100000:2.0:1790895473.007735:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741015296 00000100:00100000:2.0:1790895473.007784:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:2.0:1790895473.007794:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+49:10539:x1877889741015296:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895473.008093:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+50:10539:x1877889741015296:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 300us (459us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1790895473.008100:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:3.0:1790895473.081771:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.081926:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741015552 00000100:00100000:2.0:1790895473.081938:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741015552 00000100:00100000:2.0:1790895473.082006:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 104 00000100:00100000:2.0:1790895473.082017:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+50:10549:x1877889741015552:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895473.082043:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895473.082048:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790895473.082076:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8def lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e03 expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.082095:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895473.082100:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895473.082112:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e74 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e26 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.082228:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.082243:0:7639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 50 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.082252:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.082286:0:7639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 50 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.082327:0:7639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 50 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895473.082351:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758854912:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895473.082462:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3100b96c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895473.088518:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895473.088800:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741015680 00000100:00100000:0.0:1790895473.088811:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741015680 00010000:00010000:0.0:1790895473.088853:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 51 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895473.088937:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405a1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758854912:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895473.088962:0:7639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895473.089131:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:0.0:1790895473.089139:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+51:2361:x1877889741015680:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895473.089152:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895473.089158:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 51 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.089179:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 51 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.089210:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf8e5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e1f expref: 51 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.089221:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895473.089224:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.089231:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.089236:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.089257:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895473.089291:0:7639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.089300:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895473.089318:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1790895473.089476:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e74 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 52 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.089493:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 51 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.089500:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895473.089503:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790895473.089505:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84ec00, rc 0) 00000100:00100000:0.0:1790895473.089521:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+51:2361:x1877889741015680:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 380us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895473.089530:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:2.0:1790895473.089535:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+51:10549:x1877889741015552:12345-192.168.201.54@tcp:101:bash.0 Request processed in 7519us (7771us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1790895473.089545:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 104 00000100:00100000:1.0:1790895473.100591:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.100707:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741015936 00000100:00100000:2.0:1790895473.100718:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741015936 00000100:00100000:2.0:1790895473.100815:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 105 00000100:00100000:2.0:1790895473.100826:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+50:10549:x1877889741015936:12345-192.168.201.54@tcp:36:bash.0 00010000:00010000:2.0:1790895473.101177:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.101196:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.101208:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790895473.101259:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1790895473.101285:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000918dad57 reply state 00000000a11e4307 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895473.101293:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790895473.101382:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+53:10549:x1877889741015936:12345-192.168.201.54@tcp:36:bash.0 Request processed in 557us (801us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1790895473.101389:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 105 00000020:00080000:2.0:1790895473.101394:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1790895473.104957:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895473.105049:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741016064 00000100:00100000:0.0:1790895473.105058:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741016064 00010000:00010000:2.0:1790895473.105067:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.105081:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.105090:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.105096:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895473.105101:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.105109:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895473.105117:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 106 00000100:00100000:0.0:1790895473.105128:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+53:10549:x1877889741016064:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895473.105144:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895473.105149:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895473.105153:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.105154:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895473.105162:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8e89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.105173:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e2d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.105256:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.105279:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 53 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.105288:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.105319:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 53 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.105346:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 53 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895473.105360:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758855040:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895473.105439:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305962900 going to sleep for 11 seconds 00000100:00100000:3.0:1790895473.108014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.108071:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741016192 00000100:00100000:2.0:1790895473.108081:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741016192 00010000:00010000:2.0:1790895473.108118:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 54 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895473.108159:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:2.0:1790895473.108168:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+54:2361:x1877889741016192:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895473.108182:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895473.108187:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 54 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.108212:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 54 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.108232:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895473.108237:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.108246:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.108272:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.108307:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895473.108366:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+54:2361:x1877889741016192:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 199us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895473.108374:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 53 00010000:00010000:0.0:1790895473.108891:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8e7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e26 expref: 53 pid: 7639 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895473.108923:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758855040:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895473.108946:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.108956:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.108971:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895473.109016:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790895473.109030:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895473.109054:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.109085:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 53 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.109099:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.109107:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895473.109109:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895473.109112:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d800, rc 0) 00000100:00100000:0.0:1790895473.109147:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+52:10549:x1877889741016064:12345-192.168.201.54@tcp:101:bash.0 Request processed in 4022us (4201us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895473.109166:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 106 00000100:00100000:2.0:1790895473.119996:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.120031:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741016448 00000100:00100000:2.0:1790895473.120041:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741016448 00000100:00100000:2.0:1790895473.120090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:2.0:1790895473.120099:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+52:10549:x1877889741016448:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:2.0:1790895473.120320:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+53:10549:x1877889741016448:12345-192.168.201.54@tcp:35:bash.0 Request processed in 221us (331us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1790895473.120327:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 29 00000001:00080000:0.0:1790895473.169450:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00080000:0.0:1790895473.169473:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1790895473.169482:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1790895473.169487:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1790895473.171638:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895473.172573:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741016576 00000100:00100000:0.0:1790895473.172584:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741016576 00000100:00100000:0.0:1790895473.172638:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 107 00000100:00100000:0.0:1790895473.172647:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+53:10555:x1877889741016576:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895473.172670:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895473.172690:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e34 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.172756:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ea5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.172774:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.172783:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895473.172810:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1790895473.172813:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895473.172826:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.172843:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8e9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e34 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.172903:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e34 expref: 54 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.172922:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895473.172927:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895473.172930:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d400, rc 0) 00000100:00100000:1.0:1790895473.173034:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10555:x1877889741016576:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 387us (1404us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895473.173042:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 107 00000040:00080000:2.0:1790895473.176323:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895473.176332:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895473.176389:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1790895473.176508:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790895473.176590:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.176685:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741016704 00000100:00100000:2.0:1790895473.176695:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741016704 00000100:00100000:2.0:1790895473.176751:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 108 00000100:00100000:2.0:1790895473.176763:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10555:x1877889741016704:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895473.176785:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895473.176805:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8eac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e3b expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.176920:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.176935:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.176947:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.176962:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.176970:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.176976:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177047:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ec1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177056:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177064:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895473.177098:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1790895473.177102:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895473.177119:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177140:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ec1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177149:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177156:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177163:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177168:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895473.177172:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177180:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177192:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895473.177196:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895473.177200:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177207:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8eb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177218:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177225:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177238:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177243:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895473.177246:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177251:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177259:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf310c7ee00) 00010000:00010000:2.0:1790895473.177261:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895473.177264:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177270:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8eba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177299:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf8eac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e3b expref: 56 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177311:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ec1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e3b expref: 55 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.177319:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895473.177321:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895473.177323:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84ec00, rc 0) 00000100:00100000:2.0:1790895473.177377:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10555:x1877889741016704:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 616us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895473.177393:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 108 00000100:00100000:2.0:1790895473.183278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.183321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895473.183378:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741017088 00000100:00100000:0.0:1790895473.183395:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741017088 00000100:00100000:0.0:1790895473.183455:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:0.0:1790895473.183466:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+55:2364:x1877889741017088:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895473.183482:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895473.183507:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ec1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e3b expref: 55 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.183545:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895473.183550:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895473.183613:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+54:2364:x1877889741017088:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 149us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895473.183621:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:3.0:1790895473.183967:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741016960 00000100:00100000:3.0:1790895473.183972:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741016960 00000100:00100000:3.0:1790895473.183998:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 109 00000100:00100000:3.0:1790895473.184005:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10555:x1877889741016960:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895473.184021:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895473.184036:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8ec8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e42 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895473.184129:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895473.184142:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895473.184150:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895473.184194:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895473.184221:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 55 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895473.184244:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758855168:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895473.184351:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3052a4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895473.189649:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758855168:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895473.189679:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895473.190350:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.190428:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741017216 00000100:00100000:2.0:1790895473.190436:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741017216 00010000:00010000:2.0:1790895473.190473:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 56 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895473.190510:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 54 00000100:00100000:2.0:1790895473.190519:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306504850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+56:2361:x1877889741017216:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895473.190535:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895473.190541:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 56 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.190564:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 56 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.190585:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8e97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e2d expref: 56 pid: 5832 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.190601:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895473.190606:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.190615:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.190623:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.190669:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895473.190719:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306504850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+55:2361:x1877889741017216:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 201us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895473.190728:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 54 00010000:00010000:0.0:1790895473.191025:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.191034:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895473.191053:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1790895473.191208:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf8ec8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.191227:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.191235:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895473.191238:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790895473.191241:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167da00, rc 0) 00000100:00100000:0.0:1790895473.191279:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10555:x1877889741016960:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 7274us (8011us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1790895473.191286:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 109 00000100:00100000:1.0:1790895473.194805:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895473.194919:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741017472 00000100:00100000:0.0:1790895473.194931:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741017472 00000100:00100000:0.0:1790895473.194986:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1790895473.195012:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10555:x1877889741017472:12345-192.168.201.54@tcp:103:lfs.0 00010000:00010000:0.0:1790895473.195027:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895473.195051:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8e2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e18 expref: 55 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895473.195071:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895473.195075:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895473.195120:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10555:x1877889741017472:12345-192.168.201.54@tcp:103:lfs.0 Request processed in 112us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895473.195128:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:2.0:1790895473.197134:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895473.197231:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741017600 00000100:00100000:3.0:1790895473.197240:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741017600 00000100:00100000:3.0:1790895473.197567:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 110 00000100:00100000:3.0:1790895473.197579:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10555:x1877889741017600:12345-192.168.201.54@tcp:58:lfs.0 00010000:00010000:3.0:1790895473.197688:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895473.197716:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895473.197727:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790895473.197958:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1790895473.198027:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10555:x1877889741017600:12345-192.168.201.54@tcp:58:lfs.0 Request processed in 452us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895473.198033:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 110 00000100:00100000:1.0:1790895473.199667:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895473.199731:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741017728 00000100:00100000:2.0:1790895473.199739:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741017728 00000100:00100000:2.0:1790895473.199786:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 111 00000100:00100000:2.0:1790895473.199796:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+54:10555:x1877889741017728:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895473.199815:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895473.199832:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e49 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.199902:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.199922:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.199935:0:5831:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.199944:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.199955:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895473.199957:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790895473.199970:0:5831:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 55 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895473.199975:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e200, rc 0) 00000100:00100000:2.0:1790895473.200016:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10555:x1877889741017728:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 223us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895473.200023:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 111 00010000:00010000:1.0:1790895473.369506:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790895474.136365:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 347103504075ns, next at 348103501897ns, rc = 0 00000100:00100000:2.0:1790895474.136404:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758855680:0@lo:400:kworker.0 00000100:00100000:2.0:1790895474.136475:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895474.136522:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758855424:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.136556:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895474.136582:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895474.136616:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895474.136635:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758855936:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.136656:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895474.136677:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790895474.136677:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1790895474.136683:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758855808:0@lo:400:kworker.0 00000100:00100000:2.0:1790895474.136683:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf307680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758855552:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.136706:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895474.136706:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895474.136720:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758856064:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.136736:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758855424 00000100:00100000:2.0:1790895474.136739:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895474.136743:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758855424 00000100:00100000:2.0:1790895474.136761:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758855808 00000100:00100000:2.0:1790895474.136764:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758855808 00000100:00100000:3.0:1790895474.136782:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1790895474.136791:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758855424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895474.136795:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758856064 00000100:00100000:2.0:1790895474.136797:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758856064 00000100:00100000:2.0:1790895474.136814:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790895474.136820:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758855808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.136837:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758855424:12345-0@lo:400:kworker.0 Request processed in 47us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.136844:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1790895474.136847:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758855808:12345-0@lo:400:kworker.0 Request processed in 28us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895474.136852:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1790895474.136880:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1790895474.136887:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758856064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.136903:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758855296 00000100:00100000:3.0:1790895474.136907:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758855296 00000100:00100000:3.0:1790895474.136931:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790895474.136937:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758855296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895474.136964:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895474.136995:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758855296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.137001:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:3.0:1790895474.137017:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895474.137021:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895474.137051:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758855808:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.137060:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758855424:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.137072:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758855296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895474.137104:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758855680 00000100:00100000:3.0:1790895474.137108:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758855680 00000100:00100000:3.0:1790895474.137138:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758855936 00000100:00100000:3.0:1790895474.137141:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758855936 00000100:00100000:3.0:1790895474.137154:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758855552 00000100:00100000:3.0:1790895474.137156:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758855552 00000100:00100000:3.0:1790895474.137169:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790895474.137175:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758855680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.137214:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758855680:12345-0@lo:400:kworker.0 Request processed in 40us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.137220:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1790895474.137232:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790895474.137238:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758855936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.137266:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758855936:12345-0@lo:400:kworker.0 Request processed in 28us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.137272:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1790895474.137283:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1790895474.137289:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758855552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.137314:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758855552:12345-0@lo:400:kworker.0 Request processed in 25us (608us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.137319:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1790895474.137334:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895474.137350:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758855936:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.137406:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf307680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758855552:0@lo:400:kworker.0 00000100:00100000:3.0:1790895474.137416:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758855680:0@lo:400:kworker.0 00000100:00100000:2.0:1790895474.137450:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758856064:12345-0@lo:400:kworker.0 Request processed in 563us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.137458:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1790895474.137463:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000100:00100000:2.0:1790895474.137463:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000004:00080000:3.0:1790895474.137478:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf307681c00, transno 4294967301 00000004:00080000:3.0:1790895474.137486:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1790895474.137497:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758856064:0@lo:400:kworker.0 00000040:00080000:2.0:1790895474.201003:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895474.201013:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895474.201074:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1790895474.201082:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790895474.201207:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405a1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758856192:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790895474.201377:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3012ed3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895474.210707:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.210782:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741017856 00000100:00100000:3.0:1790895474.210791:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741017856 00000100:00100000:3.0:1790895474.210849:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 112 00000100:00100000:3.0:1790895474.210884:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741017856:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790895474.210936:0:7639:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790895474.211029:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741017856:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 173us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.211035:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 112 00000100:00100000:2.0:1790895474.212055:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405a1500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758856192:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790895474.216440:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895474.216538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741017984 00000100:00100000:0.0:1790895474.216548:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741017984 00000100:00100000:0.0:1790895474.216607:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:0.0:1790895474.216616:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10556:x1877889741017984:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1790895474.216687:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216702:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216713:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216726:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216732:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216754:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216774:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216781:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216787:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895474.216823:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790895474.216827:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895474.216839:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216850:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216882:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216889:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216914:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.216918:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216925:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216945:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:0.0:1790895474.216948:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895474.216954:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216960:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8eeb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216974:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216981:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216987:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.216993:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.216995:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217001:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217008:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8cf31037c200) 00010000:00010000:0.0:1790895474.217010:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895474.217013:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217019:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8ef2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217042:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217048:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217054:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217059:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.217062:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217067:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217075:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895474.217077:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895474.217079:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.217085:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8ef9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.217207:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10556:x1877889741017984:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 Request processed in 590us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.217214:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:1.0:1790895474.221102:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.222072:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741018240 00000100:00100000:3.0:1790895474.222083:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741018240 00000100:00100000:3.0:1790895474.222186:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:3.0:1790895474.222194:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+55:10556:x1877889741018240:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.222212:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895474.222229:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f00 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e50 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222304:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222316:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222339:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895474.222347:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790895474.222432:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222437:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222441:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222444:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895474.222447:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222451:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222460:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:3.0:1790895474.222461:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790895474.222464:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222468:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222497:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f00 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e50 expref: 57 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222511:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:3.0:1790895474.222513:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895474.222515:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f00 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e50 expref: 57 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.222522:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c200, rc 0) 00000100:00100000:3.0:1790895474.222571:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741018240:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 377us (1479us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1790895474.222578:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:1.0:1790895474.224994:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895474.225077:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741018368 00000100:00100000:0.0:1790895474.225088:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741018368 00000100:00100000:0.0:1790895474.225224:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:0.0:1790895474.225247:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741018368:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790895474.225280:0:5832:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790895474.225371:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741018368:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 126us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.225378:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:1.0:1790895474.227816:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895474.228656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741018624 00000100:00100000:2.0:1790895474.228666:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741018624 00000100:00100000:2.0:1790895474.228943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:2.0:1790895474.228955:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741018624:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895474.228974:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895474.228977:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1790895474.229003:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8ea5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e34 expref: 56 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.229022:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:2.0:1790895474.229028:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895474.229041:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8f15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e57 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790895474.229504:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1790895474.229684:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8f1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.229712:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.229730:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8f1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.229780:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf8f15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e57 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.229797:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8f1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e57 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.229804:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:2.0:1790895474.229808:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895474.229810:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fe00, rc 0) 00000100:00100000:2.0:1790895474.229903:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+57:10556:x1877889741018624:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 939us (2083us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1790895474.229911:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:1.0:1790895474.233030:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.233207:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741018880 00000100:00100000:3.0:1790895474.233218:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741018880 00000100:00100000:3.0:1790895474.233295:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:3.0:1790895474.233305:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+57:10556:x1877889741018880:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.233357:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895474.233440:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8f1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e57 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233460:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:3.0:1790895474.233472:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895474.233494:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233506:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233515:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233545:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233552:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233560:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233621:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233629:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233636:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233641:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895474.233645:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233652:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233660:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:3.0:1790895474.233662:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895474.233666:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233672:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233703:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233710:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233716:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233721:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895474.233724:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233730:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233737:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x7c9e7e3a (ffff8cf3183e2300) 00010000:00010000:3.0:1790895474.233740:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895474.233743:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.233748:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x7c9e7e3a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.233829:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741018880:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 525us (807us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790895474.233836:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:2.0:1790895474.236010:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895474.236104:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741019008 00000100:00100000:0.0:1790895474.236113:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741019008 00000100:00100000:0.0:1790895474.236236:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:0.0:1790895474.236246:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+56:10556:x1877889741019008:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895474.236264:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895474.236283:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f38 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e5e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.236316:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.236327:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.236338:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.236501:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f38 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.236520:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.236539:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:0.0:1790895474.236541:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895474.236545:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c200, rc 0) 00000100:00100000:0.0:1790895474.236636:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+57:10556:x1877889741019008:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 391us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.236642:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:1.0:1790895474.239695:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895474.239784:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741019264 00000100:00100000:2.0:1790895474.239793:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741019264 00000100:00100000:2.0:1790895474.240001:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00100000:2.0:1790895474.240012:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+57:10556:x1877889741019264:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1790895474.240095:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.240113:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.240125:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790895474.240496:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00010000:2.0:1790895474.240584:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003ac83a68 reply state 00000000676f5836 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.240594:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790895474.240723:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+59:10556:x1877889741019264:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 712us (1035us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1790895474.240731:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 119 00000100:00100000:1.0:1790895474.243623:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00010000:00010000:3.0:1790895474.243751:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.243780:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.243787:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.243794:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895474.243798:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.243806:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.243822:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:3.0:1790895474.243825:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1790895474.243830:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.243837:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf8f46 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.246035:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741019392 00000100:00100000:0.0:1790895474.246050:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741019392 00000100:00100000:0.0:1790895474.246116:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 120 00000100:00100000:0.0:1790895474.246127:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+58:10556:x1877889741019392:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895474.246251:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895474.246271:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e65 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.246335:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.246349:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.246369:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:0.0:1790895474.246372:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895474.246375:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7ca00, rc 0) 00000100:00100000:0.0:1790895474.246637:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+59:10556:x1877889741019392:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 512us (3022us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.246662:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 120 00000100:00100000:0.0:1790895474.250168:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.250224:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741019520 00000100:00100000:3.0:1790895474.250236:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741019520 00000100:00100000:3.0:1790895474.250305:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:3.0:1790895474.250315:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741019520:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1790895474.250597:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895474.250977:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2361:x1877889741019520:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 660us (817us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790895474.250985:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:0.0:1790895474.253138:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.253336:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741019776 00000100:00100000:3.0:1790895474.253357:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741019776 00000100:00100000:0.0:1790895474.253595:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:0.0:1790895474.253606:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+59:10556:x1877889741019776:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1790895474.253888:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+60:10556:x1877889741019776:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 283us (764us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1790895474.253905:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:1.0:1790895474.255624:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.255713:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741020032 00000100:00100000:3.0:1790895474.255722:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741020032 00000100:00100000:3.0:1790895474.255775:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 121 00000100:00100000:3.0:1790895474.255785:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+60:10556:x1877889741020032:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790895474.255916:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+60:10556:x1877889741020032:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 132us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.255923:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 121 00000100:00100000:1.0:1790895474.257774:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.257849:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741020160 00000100:00100000:3.0:1790895474.257888:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741020160 00000100:00100000:3.0:1790895474.257943:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 122 00000100:00100000:3.0:1790895474.257954:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+60:10556:x1877889741020160:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.257972:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895474.257991:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e6c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.258057:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.258071:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.258083:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895474.258119:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895474.258150:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.258178:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e6c expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.258213:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e6c expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.258222:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:3.0:1790895474.258226:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790895474.258229:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c200, rc 0) 00000100:00100000:3.0:1790895474.258283:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc01500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+61:10556:x1877889741020160:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 332us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.258291:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 122 00000100:00100000:1.0:1790895474.260776:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.260884:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741020288 00000100:00100000:3.0:1790895474.260904:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741020288 00000100:00100000:3.0:1790895474.260960:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:3.0:1790895474.260970:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2362:x1877889741020288:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.260989:0:8701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895474.261008:0:8701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e73 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895474.261032:0:8701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abee572, blocks: 0x1 00010000:00010000:3.0:1790895474.261050:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1790895474.261055:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895474.261064:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 10 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.261082:0:8701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 10 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.261115:0:8701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895474.261175:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2362:x1877889741020288:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 206us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.261182:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:2.0:1790895474.263722:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.264012:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741020544 00000100:00100000:3.0:1790895474.264022:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741020544 00000100:00100000:3.0:1790895474.264074:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 123 00000100:00100000:3.0:1790895474.264084:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+61:10556:x1877889741020544:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790895474.264202:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+61:10556:x1877889741020544:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 119us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.264211:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 123 00000100:00100000:1.0:1790895474.266533:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895474.266614:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741020672 00000100:00100000:2.0:1790895474.266624:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741020672 00000100:00100000:2.0:1790895474.266676:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:2.0:1790895474.266685:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+10:10556:x1877889741020672:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895474.266703:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895474.266720:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e7a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.266750:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 11 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.266759:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895474.266763:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895474.266769:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.266801:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 11 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.266840:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 11 pid: 8701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.266855:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758856320:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895474.266990:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf311e949c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895474.270210:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.270330:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741020800 00000100:00100000:3.0:1790895474.270340:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741020800 00010000:00010000:3.0:1790895474.270377:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 12 pid: 8701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.270427:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00100000:3.0:1790895474.270436:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+12:2361:x1877889741020800:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895474.270450:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895474.270471:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 12 pid: 8701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.270495:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 12 pid: 8701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.270524:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895474.270529:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895474.270537:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.270547:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.270582:0:5816:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.270597:0:5816:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1877889758856448:192.168.201.54@tcp:105: 00000100:00100000:3.0:1790895474.270677:0:5816:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3052a4840 going to sleep for 11 seconds 00010000:00010000:2.0:1790895474.271735:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf8f62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e73 expref: 12 pid: 8701 timeout: 447 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.271755:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758856320:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895474.271781:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.271792:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e400, rc 0) 00000100:00100000:2.0:1790895474.271842:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+11:10556:x1877889741020672:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 5158us (5317us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895474.271850:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:3.0:1790895474.274099:0:5816:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5816:1877889758856448:192.168.201.54@tcp:105: 00010000:00010000:3.0:1790895474.274122:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895474.274180:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2361:x1877889741020800:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 3745us (3979us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.274191:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00100000:1.0:1790895474.276653:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895474.276732:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741020928 00000100:00100000:0.0:1790895474.276743:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741020928 00002000:00100000:0.0:1790895474.276795:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cf336f16a00 x1877889741020928/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:0/0 lens 504/0 e 0 to 0 dl 1790895485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895474.276806:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf336f16a00 with x1877889741020928 ext(0->12) 00002000:00010000:0.0:1790895474.276810:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf336f16a00 00000100:00100000:0.0:1790895474.276843:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:0.0:1790895474.276852:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2362:x1877889741020928:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790895474.277362:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+12:2362:x1877889741020928:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 Request processed in 509us (716us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1790895474.277371:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00002000:00100000:0.0:1790895474.277390:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8cf336f16a00 x1877889741020928/t4294967308(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:0/0 lens 504/448 e 0 to 0 dl 1790895485 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895474.277398:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf336f16a00 with x1877889741020928 ext(0->12) 00002000:00010000:0.0:1790895474.277413:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf336f16a00 00000100:00100000:1.0:1790895474.280607:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.280683:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741021056 00000100:00100000:3.0:1790895474.280692:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741021056 00000100:00100000:3.0:1790895474.280765:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 124 00000100:00100000:3.0:1790895474.280775:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+61:10556:x1877889741021056:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790895474.308430:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1790895474.308454:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1790895474.308482:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf3181facc0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1790895474.308487:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf336bdad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf3141c7a80 00000020:00080000:1.0:1790895474.308491:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf336bda000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf3396bf800 00000004:00080000:1.0:1790895474.308517:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1790895474.308529:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf33919b6c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1790895474.308532:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f838c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf33919b480 00000020:00080000:1.0:1790895474.308535:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f838a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf3405fc400 00000004:00080000:1.0:1790895474.308557:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1790895474.308607:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1790895474.308780:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1790895474.309028:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758856704:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1790895474.309094:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895474.309213:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758856576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1790895474.309243:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895474.309308:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758856704 00000100:00100000:2.0:1790895474.309316:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758856704 00000100:00100000:2.0:1790895474.309360:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758856576 00000100:00100000:2.0:1790895474.309364:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758856576 00000100:00100000:2.0:1790895474.309394:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790895474.309402:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3101d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758856704:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1790895474.309435:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:2.0:1790895474.309465:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6abee571, atime: 0x6abee571, ctime: 0x6abee571, blocks: 0xb 00010000:00010000:2.0:1790895474.309473:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.309490:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=347s v=(0 0) 00010000:00010000:2.0:1790895474.309494:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895474.309501:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.309516:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.309527:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.309535:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.309553:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790895474.310047:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3101d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758856704:12345-0@lo:6:osp-syn-1-0.0 Request processed in 645us (951us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1790895474.310055:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790895474.310285:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790895474.310295:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758856576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1790895474.310311:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1790895474.310327:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.310344:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.310352:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1790895474.310355:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790895474.310360:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.310397:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.310436:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 11 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895474.310448:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1877889758856832:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895474.310511:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895474.313065:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10556:x1877889741021056:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 Request processed in 32282us (32457us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.313076:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 124 00010000:00010000:2.0:1790895474.313816:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895474.313827:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.313898:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ee00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895474.313904:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.313916:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.313937:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.313945:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008575fd84/0x7911a98710cf8f70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.313968:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895474.313970:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895474.313972:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790895474.314017:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf3405ad880/2, rc 0, transno 4294967304 00000100:00100000:2.0:1790895474.314025:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758856704:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1790895474.315977:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895474.316002:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.316087:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f17100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6691:1877889758856832:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895474.316128:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.316251:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741021184 00000100:00100000:0.0:1790895474.316258:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741021184 00010000:00010000:0.0:1790895474.316292:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 12 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.316331:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:0.0:1790895474.316340:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+12:2361:x1877889741021184:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895474.316355:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895474.316361:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 12 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.316396:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 12 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.316418:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf8d32 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dd9 expref: 12 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.316436:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895474.316441:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895474.316447:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.316457:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.316495:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895474.316537:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f16680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:2361:x1877889741021184:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 198us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.316544:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:2.0:1790895474.316654:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741021312 00000100:00100000:2.0:1790895474.316658:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741021312 00000100:00100000:2.0:1790895474.316791:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:2.0:1790895474.316801:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+11:2362:x1877889741021312:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1790895474.317029:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.317038:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.317047:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.317055:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.317079:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1790895474.317582:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1877889758856576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7288us (8337us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1790895474.317589:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:1.0:1790895474.317629:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf30fe6dc00/2, rc 0, transno 4294967309 00000100:00100000:1.0:1790895474.317645:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758856576:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1790895474.318236:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895474.318244:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.318268:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895474.318272:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.318282:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.318299:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.318307:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2bf6ad1/0x7911a98710cf8f77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.318328:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895474.318330:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895474.318331:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1790895474.350962:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:0.0:1790895474.350986:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:2.0:1790895474.351125:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889741021312:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 Request processed in 34321us (35116us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895474.353254:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:1.0:1790895474.353768:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.353855:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741021568 00000100:00100000:3.0:1790895474.353880:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741021568 00000100:00100000:3.0:1790895474.353973:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 125 00000100:00100000:3.0:1790895474.353984:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10556:x1877889741021568:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.354039:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895474.354066:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8f5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e6c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.354090:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:3.0:1790895474.354095:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895474.354125:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.354151:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.354162:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790895474.354447:0:7639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000879bd960 reply state 0000000056949c43 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.354458:0:7639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790895474.354552:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10556:x1877889741021568:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 569us (785us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1790895474.354559:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 125 00000100:00100000:1.0:1790895474.356929:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.357355:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741021696 00000100:00100000:3.0:1790895474.357365:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741021696 00000100:00100000:3.0:1790895474.357432:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:3.0:1790895474.357442:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889741021696:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790895474.357668:0:8701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1790895474.357672:0:8701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790895473 00002000:00010000:3.0:1790895474.357675:0:8701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790895473 00002000:00010000:3.0:1790895474.357678:0:8701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790895474 -> 1790895473 00002000:00010000:3.0:1790895474.357680:0:8701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790895474.357924:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741021696:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 483us (1002us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790895474.357932:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:1.0:1790895474.359568:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895474.359651:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741021952 00000100:00100000:0.0:1790895474.359661:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741021952 00000100:00100000:0.0:1790895474.359711:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 126 00000100:00100000:0.0:1790895474.359720:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+16:10556:x1877889741021952:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790895474.359782:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.359799:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.359808:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.359839:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.359905:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 16 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.359920:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758856960:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895474.360006:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895474.362953:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758856960:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895474.362982:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895474.363060:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.363299:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741022080 00000100:00100000:3.0:1790895474.363306:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741022080 00010000:00010000:3.0:1790895474.363337:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.363384:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:3.0:1790895474.363393:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:2361:x1877889741022080:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895474.363407:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895474.363412:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.363436:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.363456:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf8f3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e5e expref: 17 pid: 5832 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.363483:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:3.0:1790895474.363488:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.363497:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.363504:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.363530:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895474.363571:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f15880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:2361:x1877889741022080:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 179us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.363578:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 57 00010000:00010000:1.0:1790895474.363756:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363767:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363798:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363806:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363814:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363821:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895474.363826:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363834:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363845:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:1.0:1790895474.363849:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1790895474.363853:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.363914:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf8f85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895474.363960:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10556:x1877889741021952:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 Request processed in 4241us (4398us total) trans 0 rc -22/-22 00000100:00100000:1.0:1790895474.363968:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 126 00010000:00010000:2.0:1790895474.366836:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.366853:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.366883:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.366911:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895474.366916:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.366924:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.366941:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:2.0:1790895474.366944:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895474.366949:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.366956:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf8f7e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895474.367208:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.367261:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741022208 00000100:00100000:3.0:1790895474.367270:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741022208 00000100:00100000:3.0:1790895474.367322:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:3.0:1790895474.367332:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741022208:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.367371:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.367397:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.367407:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895474.367411:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790895474.367415:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.367457:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.367484:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 7 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.367498:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758857088:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895474.367787:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305962900 going to sleep for 11 seconds 00000100:00100000:1.0:1790895474.371351:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.371751:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758857088:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895474.371779:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.371911:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741022336 00000100:00100000:2.0:1790895474.371918:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741022336 00010000:00010000:2.0:1790895474.371953:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 8 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.371987:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 58 00000100:00100000:2.0:1790895474.371996:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741022336:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895474.372010:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895474.372032:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 8 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.372058:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 8 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.372100:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf8f69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e7a expref: 8 pid: 6688 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.372116:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790895474.372122:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790895474.372127:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.372148:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.372174:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895474.372218:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741022336:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 223us (877us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895474.372225:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 58 00010000:00010000:1.0:1790895474.372465:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372475:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372501:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372509:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372517:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372524:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895474.372528:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372549:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372561:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.372569:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf8f8c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895474.372619:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f15f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889741022208:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 Request processed in 5290us (5415us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895474.372627:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:2.0:1790895474.374781:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895474.375011:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741022592 00000100:00100000:0.0:1790895474.375021:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741022592 00000100:00100000:0.0:1790895474.375072:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 127 00000100:00100000:0.0:1790895474.375082:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10556:x1877889741022592:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790895474.375245:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.375263:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.375274:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.375532:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.375543:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.375551:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.375581:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.375621:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 15 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.375636:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758857216:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895474.375752:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1790895474.379221:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895474.379658:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758857216:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895474.379685:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.379833:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741022720 00000100:00100000:3.0:1790895474.379840:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741022720 00010000:00010000:3.0:1790895474.380033:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 16 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.380063:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:3.0:1790895474.380074:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:2361:x1877889741022720:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895474.380089:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895474.380095:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 16 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.380120:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 16 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.380257:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf8f4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e65 expref: 16 pid: 5831 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.380272:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:3.0:1790895474.380277:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.380287:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.380295:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.380357:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895474.380428:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+15:2361:x1877889741022720:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 356us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.380436:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 59 00010000:00010000:0.0:1790895474.381582:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.381598:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895474.382028:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1790895474.382256:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1790895474.382785:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1790895474.383099:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758857344:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790895474.383222:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895474.383288:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895474.383325:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758857344 00000100:00100000:3.0:1790895474.383332:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758857344 00000100:00100000:3.0:1790895474.383477:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895474.383488:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1877889758857344:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790895474.383564:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1877889758857344:12345-0@lo:1000:mdt00_002.0 Request processed in 78us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.383571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790895474.383622:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1790895474.383629:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:0.0:1790895474.383648:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf30fe6dc00, transno 4294967309 00000100:00100000:0.0:1790895474.383671:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758857344:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790895474.384155:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1790895474.384218:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758857472:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790895474.384247:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895474.384699:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895474.384742:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758857472 00000100:00100000:2.0:1790895474.384748:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758857472 00000100:00100000:2.0:1790895474.384777:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895474.384785:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5833:x1877889758857472:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1790895474.385200:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1877889758857472:12345-0@lo:1000:mdt00_002.0 Request processed in 415us (952us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1790895474.385208:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790895474.385271:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758857472:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1790895474.385302:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385311:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385319:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385325:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.385330:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385339:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385353:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf31037c200) 00010000:00010000:0.0:1790895474.385356:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895474.385361:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385368:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf8f9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385495:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385503:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385518:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385523:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167dc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.385526:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385533:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385541:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895474.385544:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895474.385551:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385562:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385571:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.385598:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.385610:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758857600:192.168.201.54@tcp:105: 00000100:00100000:0.0:1790895474.385717:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3056e3480 going to sleep for 11 seconds 00000100:00100000:1.0:1790895474.389360:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895474.389484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741022848 00000100:00100000:2.0:1790895474.389494:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741022848 00000100:00100000:2.0:1790895474.389565:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:2.0:1790895474.389575:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10555:x1877889741022848:12345-192.168.201.54@tcp:49:lfs.0 00000100:00100000:2.0:1790895474.389705:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10555:x1877889741022848:12345-192.168.201.54@tcp:49:lfs.0 Request processed in 132us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895474.389713:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:0.0:1790895474.389851:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758857600:192.168.201.54@tcp:105: 00010000:00010000:0.0:1790895474.389908:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.389918:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8edd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.389952:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.389966:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.389978:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.389988:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.389995:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390002:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390007:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.390011:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390019:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390030:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895474.390033:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895474.390044:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390050:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf8fa1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390061:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390067:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390073:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390078:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.390081:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390087:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390095:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895474.390097:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895474.390100:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.390106:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf8f93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895474.392333:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.392396:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741023104 00000100:00100000:3.0:1790895474.392406:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741023104 00000100:00100000:3.0:1790895474.392454:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 128 00000100:00100000:3.0:1790895474.392464:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10555:x1877889741023104:12345-192.168.201.54@tcp:58:lfs.0 00000040:00080000:3.0:1790895474.392816:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00010000:00010000:2.0:1790895474.392964:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895474.393470:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895474.393476:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895474.393505:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1790895474.393511:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790895474.393605:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758857728:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790895474.393664:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:10555:x1877889741023104:12345-192.168.201.54@tcp:58:lfs.0 Request processed in 1200us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.393673:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 128 00000100:00100000:1.0:1790895474.393763:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10556:x1877889741022592:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 18681us (18987us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1790895474.393772:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 127 00000020:00080000:1.0:1790895474.393776:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790895474.395701:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3052a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1790895474.396055:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895474.399564:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741023360 00000100:00100000:2.0:1790895474.399582:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741023360 00000100:00100000:2.0:1790895474.399654:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:2.0:1790895474.399664:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:10556:x1877889741023360:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790895474.400749:0:5834:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790895474.400853:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1790895474.400935:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.400950:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.400961:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.400969:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.400982:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.400988:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.401011:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790895474.401093:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b67850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+21:10556:x1877889741023360:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 1429us (5040us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1790895474.401102:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 32 00000020:00080000:2.0:1790895474.401107:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1790895474.401363:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895474.401369:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.401381:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895474.401385:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.401403:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.401416:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8cf310c7e700) 00010000:00010000:1.0:1790895474.401420:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790895474.401424:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.401428:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf8fa8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895474.401441:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895474.401442:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895474.401443:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895474.404706:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.404818:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741023488 00000100:00100000:3.0:1790895474.404827:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741023488 00000100:00100000:3.0:1790895474.404910:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 129 00000100:00100000:3.0:1790895474.404920:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+21:10557:x1877889741023488:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790895474.404952:0:7639:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790895474.405045:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+21:10557:x1877889741023488:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 127us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895474.405053:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 129 00000100:00100000:0.0:1790895474.406766:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405ac700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758857728:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790895474.410065:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.410238:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741023744 00000100:00100000:3.0:1790895474.410250:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741023744 00000100:00100000:3.0:1790895474.410322:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 130 00000100:00100000:3.0:1790895474.410331:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:10557:x1877889741023744:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.410353:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895474.410374:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8faf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e81 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.410490:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8fb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.410506:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.410531:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8fb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895474.410545:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1790895474.410678:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8faf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e81 expref: 23 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.410700:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8fb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e81 expref: 22 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.410709:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:3.0:1790895474.410712:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790895474.410716:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167dc00, rc 0) 00000100:00100000:3.0:1790895474.410778:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+22:10557:x1877889741023744:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 449us (723us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1790895474.410785:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 130 00000100:00100000:1.0:1790895474.418100:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.418266:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741024000 00000100:00100000:3.0:1790895474.418276:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741024000 00000100:00100000:3.0:1790895474.418325:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 131 00000100:00100000:3.0:1790895474.418334:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+22:10557:x1877889741024000:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790895474.418468:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.418486:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.418498:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.418688:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.418849:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.419089:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.419097:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895474.419101:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.419109:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.419122:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:3.0:1790895474.419124:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790895474.419129:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895474.419135:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf8fc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895474.419415:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+23:10557:x1877889741024000:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 1079us (1322us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1790895474.419425:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 131 00000040:00080000:0.0:1790895474.421196:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790895474.421203:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790895474.422154:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1790895474.422168:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790895474.428489:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895474.428694:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741024256 00000100:00100000:1.0:1790895474.428705:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741024256 00000100:00100000:1.0:1790895474.428775:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:1.0:1790895474.428787:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+23:10557:x1877889741024256:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790895474.429089:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+24:10557:x1877889741024256:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 305us (612us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1790895474.429097:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:2.0:1790895474.443732:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895474.443828:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741024384 00000100:00100000:3.0:1790895474.443846:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741024384 00000100:00100000:3.0:1790895474.443971:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 132 00000100:00100000:3.0:1790895474.443983:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+24:10559:x1877889741024384:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895474.445354:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895474.445397:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf8fcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e88 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445471:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445487:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445501:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445518:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445537:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445559:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445784:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445797:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445806:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445839:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.445898:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 25 pid: 5833 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.445922:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758857856:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895474.446018:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3074d8240 going to sleep for 11 seconds 00000100:00100000:2.0:1790895474.449342:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405aed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758857856:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895474.449373:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.451517:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895474.451763:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741024640 00000100:00100000:1.0:1790895474.451775:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741024640 00000100:00100000:1.0:1790895474.451840:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:1.0:1790895474.451850:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+26:5600:x1877889741024640:12345-192.168.201.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790895474.452150:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+27:5600:x1877889741024640:12345-192.168.201.54@tcp:35:ldlm_bl.0 Request processed in 300us (644us total) trans 4294967412 rc 0/0 00000100:00100000:1.0:1790895474.452158:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:3.0:1790895474.455658:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895474.455729:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741024768 00000100:00100000:2.0:1790895474.455740:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741024768 00010000:00010000:2.0:1790895474.455781:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 27 pid: 5833 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895474.455841:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:2.0:1790895474.455851:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306505450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+27:2362:x1877889741024768:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895474.456013:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895474.456020:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 27 pid: 5833 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.456041:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 27 pid: 5833 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.456058:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf8ecf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e42 expref: 27 pid: 5833 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.456071:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895474.456076:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.456083:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.456089:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895474.456112:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895474.456166:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306505450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+26:2362:x1877889741024768:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 316us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895474.456174:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 60 00010000:00010000:0.0:1790895474.456201:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456209:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895474.456251:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1790895474.456256:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895474.456274:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456286:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456295:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456301:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456308:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456314:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ee00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.456319:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456326:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456347:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:0.0:1790895474.456350:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895474.456354:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456360:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ee00/0x7911a98710cf8fd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456371:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456384:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456390:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456396:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895474.456399:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456405:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456413:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8cf310c7e300) 00010000:00010000:0.0:1790895474.456416:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895474.456419:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456424:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf8fd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456474:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf8fcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e88 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456489:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e88 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895474.456497:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:0.0:1790895474.456499:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895474.456502:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fa00, rc 0) 00000100:00100000:0.0:1790895474.456539:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+25:10559:x1877889741024384:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 12559us (12821us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.456546:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 132 00000100:00100000:3.0:1790895474.648739:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895474.649059:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758857984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895474.649192:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895474.649345:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758857984 00000100:00100000:0.0:1790895474.649353:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758857984 00000100:00100000:0.0:1790895474.649498:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790895474.649509:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758857984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895474.649546:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895474.649602:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758857984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895474.649610:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1790895474.649674:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758857984:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790895475.163058:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790895475.163069:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790895475.163116:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1790895475.163122:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790895475.323348:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895475.327700:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025024 00000100:00100000:2.0:1790895475.327717:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025024 00000100:00100000:2.0:1790895475.327804:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 133 00000100:00100000:2.0:1790895475.327816:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+25:10582:x1877889741025024:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895475.327853:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895475.327904:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8fe7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e8f expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.328010:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8fee lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.328028:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8fee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.328042:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8fee lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895475.328053:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:1.0:1790895475.328526:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1790895475.328781:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf8fe7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e8f expref: 28 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.328799:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8fee lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e8f expref: 27 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.328807:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895475.328810:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790895475.328814:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e000, rc 0) 00000100:00100000:2.0:1790895475.329056:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10582:x1877889741025024:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1241us (5717us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1790895475.329080:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 133 00000100:00100000:3.0:1790895475.332079:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895475.332249:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025152 00000100:00100000:2.0:1790895475.332259:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025152 00000100:00100000:2.0:1790895475.332355:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 134 00000100:00100000:2.0:1790895475.332375:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10582:x1877889741025152:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:2.0:1790895475.332438:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332455:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332485:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332514:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332538:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332546:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332552:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ec00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895475.332557:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332564:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332575:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:2.0:1790895475.332591:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790895475.332597:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895475.332604:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf8ffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895475.332690:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+27:10582:x1877889741025152:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 325us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895475.332699:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 134 00010000:00010000:2.0:1790895475.416115:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895475.451716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895475.451820:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025280 00000100:00100000:1.0:1790895475.451830:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025280 00000100:00100000:1.0:1790895475.452072:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:1.0:1790895475.452084:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889741025280:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:1.0:1790895475.452103:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895475.452124:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf9003 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e96 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790895475.452152:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abee571, atime: 0x6abee571, ctime: 0x6abee571, blocks: 0xb 00010000:00010000:1.0:1790895475.452172:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=348s v=(0 0) 00010000:00010000:1.0:1790895475.452177:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895475.452186:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf9003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e96 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895475.452203:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf9003 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e96 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895475.452215:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c800, rc 0) 00000100:00100000:1.0:1790895475.452285:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741025280:12345-192.168.201.54@tcp:101:cat.0 Request processed in 203us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895475.452292:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:3.0:1790895475.457554:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895475.457697:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025408 00000100:00100000:0.0:1790895475.457721:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025408 00002000:00100000:0.0:1790895475.457771:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cf310112300 x1877889741025408/t0(0) o3->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:1/0 lens 488/0 e 0 to 0 dl 1790895486 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895475.457783:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf310112300 with x1877889741025408 ext(0->4095) 00002000:00010000:0.0:1790895475.457788:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf310112300 00000100:00100000:0.0:1790895475.457825:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:0.0:1790895475.457834:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889741025408:12345-192.168.201.54@tcp:3:cat.0 00000100:00100000:0.0:1790895475.458104:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889741025408:12345-192.168.201.54@tcp:3:cat.0 Request processed in 270us (559us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790895475.458112:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00002000:00100000:0.0:1790895475.458119:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff8cf310112300 x1877889741025408/t0(0) o3->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:1/0 lens 488/4536 e 0 to 0 dl 1790895486 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895475.458126:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf310112300 with x1877889741025408 ext(0->4095) 00002000:00010000:0.0:1790895475.458130:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf310112300 00010000:00010000:2.0:1790895476.440474:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895477.464202:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895477.643186:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895477.643233:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895477.643274:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895477.643315:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895477.643345:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895477.643375:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741026048 00000100:00100000:0.0:1790895477.643386:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741026048 00000100:00100000:0.0:1790895477.643444:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025664 00000100:00100000:0.0:1790895477.643448:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025664 00000100:00100000:0.0:1790895477.643473:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 132 00000100:00100000:0.0:1790895477.643483:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889741026048:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895477.643554:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889741026048:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 72us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895477.643575:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 132 00000100:00100000:0.0:1790895477.643594:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 133 00000100:00100000:0.0:1790895477.643600:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+27:2364:x1877889741025664:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895477.643625:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+27:2364:x1877889741025664:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 26us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895477.643631:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 133 00000100:00100000:2.0:1790895477.644036:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025536 00000100:00100000:2.0:1790895477.644043:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025536 00000100:00100000:2.0:1790895477.644086:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 286 00000100:00100000:2.0:1790895477.644093:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889741025536:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895477.644122:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889741025536:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 30us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895477.644128:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 286 00000100:00100000:1.0:1790895477.645418:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025792 00000100:00100000:1.0:1790895477.645432:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025792 00000100:00100000:1.0:1790895477.645493:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741025920 00000100:00100000:1.0:1790895477.645498:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741025920 00000100:00100000:1.0:1790895477.645539:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 65 00000100:00100000:1.0:1790895477.645551:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2364:x1877889741025792:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895477.645575:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00100000:2.0:1790895477.645590:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889741025920:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895477.645630:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889741025920:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 43us (2281us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895477.645632:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2364:x1877889741025792:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 80us (2393us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895477.645645:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00080000:0.0:1790895477.645831:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790895477.645846:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895477.645850:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895477.652775:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 65 00000001:00080000:0.0:1790895478.337045:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00010000:00010000:2.0:1790895478.489333:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790895479.256242:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 352223380992ns, next at 353223379090ns, rc = 0 00000100:00100000:3.0:1790895479.256321:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758858112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895479.256404:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895479.258194:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758858112 00000100:00100000:0.0:1790895479.258207:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758858112 00000100:00100000:0.0:1790895479.258284:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790895479.258295:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877889758858112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895479.258330:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1790895479.258482:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895479.258604:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758858112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895479.258885:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1877889758858112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 565us (2453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895479.258893:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1790895479.259144:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758858496:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.259189:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895479.259236:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790895479.259242:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758858368:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.259263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895479.259287:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758858240:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.259313:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895479.259336:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758858752:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.259360:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895479.259376:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895479.259381:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758858624:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.259414:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895479.259440:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758858240 00000100:00100000:2.0:1790895479.259444:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758858240 00000100:00100000:2.0:1790895479.259477:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790895479.259484:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758858240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.259523:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758858240:12345-0@lo:400:kworker.0 Request processed in 40us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895479.259529:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1790895479.259577:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758858240:0@lo:400:kworker.0 00000100:00100000:1.0:1790895479.259802:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758858496 00000100:00100000:1.0:1790895479.259836:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758858496 00000100:00100000:1.0:1790895479.259910:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758858368 00000100:00100000:1.0:1790895479.259914:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758858368 00000100:00100000:1.0:1790895479.259937:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758858624 00000100:00100000:1.0:1790895479.259940:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758858624 00000100:00100000:1.0:1790895479.259958:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790895479.259965:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758858496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895479.260003:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758858496:12345-0@lo:400:kworker.0 Request processed in 39us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895479.260010:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1790895479.260023:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790895479.260029:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758858368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895479.260055:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758858368:12345-0@lo:400:kworker.0 Request processed in 26us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895479.260060:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1790895479.260070:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1790895479.260076:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758858624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895479.260117:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758858624:12345-0@lo:400:kworker.0 Request processed in 41us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895479.260123:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1790895479.261651:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758858752 00000100:00100000:0.0:1790895479.261664:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758858752 00000100:00100000:0.0:1790895479.261735:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1790895479.261744:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758858752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895479.261821:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758858752:12345-0@lo:400:kworker.0 Request processed in 78us (2459us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895479.261826:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1790895479.262111:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895479.262116:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895479.262150:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758858368:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.262163:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758858496:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.262201:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758858624:0@lo:400:kworker.0 00000100:00100000:2.0:1790895479.262225:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1790895479.262229:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf3405ad880, transno 4294967304 00000100:00100000:2.0:1790895479.262251:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758858752:0@lo:400:kworker.0 00010000:00010000:2.0:1790895479.514455:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895479.768262:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790895479.768283:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758858880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895479.768356:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895479.768500:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758858880 00000100:00100000:2.0:1790895479.768507:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758858880 00000100:00100000:2.0:1790895479.768546:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790895479.768555:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758858880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1790895479.768589:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895479.768630:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758858880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895479.768637:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1790895479.768680:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758858880:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1790895479.866036:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967406 is committed 00000020:00080000:2.0:1790895479.866048:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf3012ed3c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1790895479.866054:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf3407a3d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf3012eda80 00000020:00080000:2.0:1790895479.866058:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf3407a3e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf33fd60800 00000001:00080000:2.0:1790895479.866077:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1790895479.866087:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000004:00080000:2.0:1790895479.866094:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:2.0:1790895479.866106:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1790895479.866128:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1790895479.867545:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1790895479.867638:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000001:00080000:2.0:1790895479.870548:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:2.0:1790895479.870562:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:1.0:1790895479.871927:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33f9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758859008:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790895479.871997:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895479.872121:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859008 00000100:00100000:3.0:1790895479.872130:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859008 00000100:00100000:3.0:1790895479.872171:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790895479.872179:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758859008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1790895479.872446:0:8701:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1790895479.872449:0:8701:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1790895473 -> 1790895473 00002000:00010000:3.0:1790895479.872452:0:8701:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 1790895473 -> 1790895473 00002000:00010000:3.0:1790895479.872454:0:8701:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1790895473 -> 1790895473 00002000:00010000:3.0:1790895479.872456:0:8701:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1790895479.872503:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758859008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 324us (505us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1790895479.872510:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1790895479.872593:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:2.0:1790895479.872599:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:2.0:1790895479.872621:0:3310:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cf33f9a1180 x1877889758859008/t4294967312(4294967312) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790895495 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1790895479.872631:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf33f9a1180/2, rc 0, transno 4294967312 00000100:00100000:2.0:1790895479.872636:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33f9a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758859008:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1790895480.539367:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895480.733099:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895480.733199:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741026176 00000100:00100000:1.0:1790895480.733209:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741026176 00000100:00100000:1.0:1790895480.733292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 135 00000100:00100000:1.0:1790895480.733304:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10235:x1877889741026176:12345-192.168.201.54@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1790895480.733418:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10235:x1877889741026176:12345-192.168.201.54@tcp:60:lhsmtool_posix.0 Request processed in 117us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895480.733425:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 135 00000100:00080000:2.0:1790895480.733912:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895480.740462:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895480.740559:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741026432 00000100:00100000:1.0:1790895480.740571:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741026432 00000100:00100000:1.0:1790895480.740627:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:1.0:1790895480.740637:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+14:10235:x1877889741026432:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790895480.741003:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+15:10235:x1877889741026432:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 366us (548us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1790895480.741012:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 35 00010000:00010000:2.0:1790895481.563258:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895482.600521:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895482.776326:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895482.776365:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895482.776397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895482.776415:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895482.776455:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895482.776480:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741026944 00000100:00100000:0.0:1790895482.776489:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741026944 00000100:00100000:0.0:1790895482.776553:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741026816 00000100:00100000:0.0:1790895482.776556:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741026816 00000100:00100000:0.0:1790895482.776580:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:0.0:1790895482.776591:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889741026944:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895482.776657:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889741026944:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 68us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895482.776664:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:0.0:1790895482.776681:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:0.0:1790895482.776687:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889741026816:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895482.776711:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2361:x1877889741026816:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895482.776718:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:0.0:1790895482.776735:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741026560 00000100:00100000:0.0:1790895482.776739:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741026560 00000100:00100000:0.0:1790895482.776776:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 288 00000100:00100000:0.0:1790895482.776783:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741026560:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895482.776806:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741026560:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 24us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895482.776825:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 288 00000100:00100000:0.0:1790895482.776850:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741026688 00000100:00100000:0.0:1790895482.776854:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741026688 00000100:00100000:0.0:1790895482.776918:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741027072 00000100:00100000:0.0:1790895482.776921:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741027072 00000100:00100000:0.0:1790895482.776937:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 137 00000100:00100000:0.0:1790895482.776943:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+15:2361:x1877889741026688:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895482.776975:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+15:2361:x1877889741026688:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 32us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895482.776981:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 137 00000100:00100000:0.0:1790895482.777399:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 138 00000100:00100000:0.0:1790895482.777407:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889741027072:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895482.777444:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889741027072:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 38us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895482.777451:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 138 00000100:00080000:0.0:1790895482.777470:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1790895482.777475:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895482.777477:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1790895483.490553:0:12305:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 18:58:01 (1790895481) 00010000:00010000:0.0:1790895483.609975:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790895483.673986:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790895483.673994:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790895483.674267:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1790895483.674273:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790895484.376097:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790895484.376147:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895484.376166:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758859264:0@lo:400:kworker.0 00000100:00100000:3.0:1790895484.376270:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895484.377128:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859264 00000100:00100000:2.0:1790895484.377137:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859264 00000100:00100000:2.0:1790895484.377194:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790895484.377204:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758859264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895484.377278:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758859264:12345-0@lo:400:kworker.0 Request processed in 76us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895484.377285:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1790895484.377331:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758859264:0@lo:400:kworker.0 00000100:00100000:0.0:1790895484.378587:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758859136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895484.378638:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895484.378782:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859136 00000100:00100000:2.0:1790895484.378788:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859136 00000100:00100000:2.0:1790895484.378874:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1790895484.378882:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758859136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895484.378909:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895484.378963:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758859136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895484.378968:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1790895484.379009:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895484.379139:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758859136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895484.387743:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758859776:0@lo:400:kworker.0 00000100:00100000:1.0:1790895484.387831:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895484.387890:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790895484.387898:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758859648:0@lo:400:kworker.0 00000100:00100000:1.0:1790895484.387927:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895484.387997:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758859520:0@lo:400:kworker.0 00000100:00100000:3.0:1790895484.388024:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895484.388069:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895484.388075:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758859392:0@lo:400:kworker.0 00000100:00100000:3.0:1790895484.388097:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895484.388394:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859648 00000100:00100000:3.0:1790895484.388403:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859648 00000100:00100000:3.0:1790895484.388535:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859520 00000100:00100000:3.0:1790895484.388539:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859520 00000100:00100000:1.0:1790895484.389012:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859392 00000100:00100000:1.0:1790895484.389018:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859392 00000100:00100000:1.0:1790895484.389063:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790895484.389072:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758859648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895484.389350:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758859648:12345-0@lo:400:kworker.0 Request processed in 279us (1421us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895484.389358:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1790895484.389378:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1790895484.389385:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758859392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895484.389610:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790895484.389620:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758859520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895484.389655:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758859520:12345-0@lo:400:kworker.0 Request processed in 37us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895484.389662:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1790895484.389707:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758859392:0@lo:400:kworker.0 00000100:00100000:3.0:1790895484.389729:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758859520:0@lo:400:kworker.0 00000100:00100000:3.0:1790895484.389891:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f14a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758859648:0@lo:400:kworker.0 00000100:00100000:0.0:1790895484.390136:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859776 00000100:00100000:0.0:1790895484.390142:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859776 00000100:00100000:0.0:1790895484.390175:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1790895484.390182:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758859776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895484.390411:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758859776:12345-0@lo:400:kworker.0 Request processed in 228us (2579us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895484.390428:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:0.0:1790895484.390450:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790895484.390454:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895484.390478:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336f15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758859776:0@lo:400:kworker.0 00000100:00100000:1.0:1790895484.390709:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758859392:12345-0@lo:400:kworker.0 Request processed in 1323us (2610us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895484.390716:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00010000:2.0:1790895484.633326:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895484.870622:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895484.870808:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741027328 00000100:00100000:3.0:1790895484.870819:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741027328 00000100:00100000:3.0:1790895484.870930:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 136 00000100:00100000:3.0:1790895484.870941:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+15:11294:x1877889741027328:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1790895484.871072:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790895484.871115:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895484.871151:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf900a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2e9d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871239:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871254:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871266:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871280:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871287:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871294:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871562:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf901f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871572:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf901f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871579:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf901f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895484.871588:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790895484.871676:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871693:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871700:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871706:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895484.871720:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871730:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871743:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:3.0:1790895484.871746:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895484.871751:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871757:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9011 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871769:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871774:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871779:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871783:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895484.871792:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871798:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871804:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cf3183e2000) 00010000:00010000:3.0:1790895484.871806:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895484.871809:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.871814:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9018 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.873109:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf900a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e9d expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.873134:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf901f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e9d expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895484.873142:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:3.0:1790895484.873144:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895484.873147:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895484.873228:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11294:x1877889741027328:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 2287us (2615us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1790895484.873237:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 136 00000100:00100000:0.0:1790895484.880767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895484.881217:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741027456 00000100:00100000:2.0:1790895484.881228:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741027456 00000100:00100000:2.0:1790895484.881287:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 137 00000100:00100000:2.0:1790895484.881296:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11294:x1877889741027456:12345-192.168.201.54@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1790895484.881407:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11294:x1877889741027456:12345-192.168.201.54@tcp:59:lhsmtool_posix.0 Request processed in 111us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895484.881414:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 137 00000100:00100000:3.0:1790895484.889293:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895484.889316:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758859904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895484.889388:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895484.889482:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758859904 00000100:00100000:3.0:1790895484.889490:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758859904 00000100:00100000:3.0:1790895484.889533:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790895484.889542:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758859904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895484.889577:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895484.889621:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758859904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895484.889627:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790895484.889673:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758859904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790895484.898147:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895484.901006:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741027584 00000100:00100000:2.0:1790895484.901021:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741027584 00000100:00100000:2.0:1790895484.901087:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:2.0:1790895484.901098:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:2361:x1877889741027584:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895484.901113:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895484.901138:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf901f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e9d expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895484.901157:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:2.0:1790895484.901163:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895484.901234:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+16:2361:x1877889741027584:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 137us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895484.901241:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000001:00080000:2.0:1790895484.955670:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1790895484.955700:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:2.0:1790895484.955723:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1790895484.955747:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:2.0:1790895484.955756:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1790895484.985557:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1790895485.658757:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790895485.725399:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790895485.725408:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790895485.725450:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1790895485.725460:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790895486.684018:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895487.102078:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895487.102759:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741027712 00000100:00100000:3.0:1790895487.102770:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741027712 00000100:00100000:3.0:1790895487.102902:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 138 00000100:00100000:3.0:1790895487.102937:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+14:11336:x1877889741027712:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895487.102959:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895487.102983:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf902d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ea4 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103084:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103101:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103115:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103149:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103158:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103178:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103805:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103815:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103822:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103827:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895487.103831:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103838:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103882:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:3.0:1790895487.103886:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895487.103891:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103899:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103969:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103976:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103982:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103987:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895487.103990:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.103996:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.104004:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cf3183e2000) 00010000:00010000:3.0:1790895487.104007:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895487.104010:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.104016:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf903b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.104057:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf902d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ea4 expref: 15 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.104067:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:3.0:1790895487.104070:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895487.104078:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf902d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ea4 expref: 15 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.104088:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167de00, rc 0) 00000100:00100000:3.0:1790895487.104149:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+14:11336:x1877889741027712:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1227us (2082us total) trans 0 rc 301/301 00000100:00100000:3.0:1790895487.104157:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 138 00000100:00080000:1.0:1790895487.109730:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895487.118397:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895487.118493:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741027968 00000100:00100000:2.0:1790895487.118504:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741027968 00000100:00100000:2.0:1790895487.118566:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 139 00000100:00100000:2.0:1790895487.118578:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+14:11336:x1877889741027968:12345-192.168.201.54@tcp:36:lfs.0 00010000:00010000:2.0:1790895487.118643:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895487.118681:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf3029cae00/0x7911a98710cf89b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ce4 expref: 14 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.118704:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2800) 00010000:00010000:2.0:1790895487.118716:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895487.118968:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.118985:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.118998:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.119011:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.119018:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.119025:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895487.120084:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790895487.120101:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.120110:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.120117:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.120123:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895487.120128:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.120136:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.120148:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf310c7e300) 00010000:00010000:2.0:1790895487.120151:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895487.120155:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.120160:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9042 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790895487.120176:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000fcb4dcd reply state 0000000061706fc3 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895487.120185:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790895487.120296:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+15:11336:x1877889741027968:12345-192.168.201.54@tcp:36:lfs.0 Request processed in 1719us (1909us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1790895487.120314:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 139 00010000:00010000:3.0:1790895487.124412:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.124432:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.124440:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.124446:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895487.124452:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.124459:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.124476:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cf310c7e700) 00010000:00010000:3.0:1790895487.124479:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895487.124484:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.124490:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e800/0x7911a98710cf9049 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895487.251507:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895487.253925:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741028096 00000100:00100000:3.0:1790895487.253942:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741028096 00000100:00100000:3.0:1790895487.254589:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 140 00000100:00100000:3.0:1790895487.254606:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+14:11344:x1877889741028096:12345-192.168.201.54@tcp:101:lctl.0 00010000:00010000:3.0:1790895487.254631:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895487.254656:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9050 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2eab expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.254796:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9057 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.254810:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.254824:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895487.254889:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790895487.254893:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895487.254914:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.254940:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9050 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eab expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.254961:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eab expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.254970:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:3.0:1790895487.254981:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895487.254985:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c200, rc 0) 00000100:00100000:3.0:1790895487.255147:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+15:11344:x1877889741028096:12345-192.168.201.54@tcp:101:lctl.0 Request processed in 545us (3648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895487.255154:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 140 00000100:00100000:2.0:1790895487.329451:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.330927:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741028224 00000100:00100000:0.0:1790895487.330943:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741028224 00000100:00100000:0.0:1790895487.331014:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 141 00000100:00100000:0.0:1790895487.331026:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+15:11350:x1877889741028224:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:1.0:1790895487.331343:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895487.331376:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf905e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2eb2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331443:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331484:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331495:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331510:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331517:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331523:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331617:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf9073 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331624:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf9073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331630:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf9073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895487.331662:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790895487.331676:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895487.331696:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf9073 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331707:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331722:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331729:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331735:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895487.331739:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331747:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331758:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:1.0:1790895487.331761:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895487.331766:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331772:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9065 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331786:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331792:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331798:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331803:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895487.331811:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331817:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331824:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8cf310cb5f00) 00010000:00010000:1.0:1790895487.331827:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895487.331830:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331835:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf906c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331913:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf905e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb2 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331927:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf9073 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb2 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.331934:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895487.331936:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790895487.331938:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ca00, rc 0) 00000100:00100000:1.0:1790895487.332009:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+16:11350:x1877889741028224:12345-192.168.201.54@tcp:101:bash.0 Request processed in 986us (2574us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895487.332016:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 141 00000100:00100000:3.0:1790895487.339985:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895487.340287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741028480 00000100:00100000:2.0:1790895487.340299:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741028480 00000100:00100000:2.0:1790895487.340362:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 142 00000100:00100000:2.0:1790895487.340373:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+16:11350:x1877889741028480:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895487.340397:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895487.340419:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf907a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2eb9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.340558:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.340573:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.340600:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.340655:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.340663:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.340688:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1790895487.346834:0:5832:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1790895487.347111:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347147:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347170:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347212:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347219:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347225:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347232:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ec00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895487.347237:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347244:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347257:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:2.0:1790895487.347260:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895487.347265:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347270:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9081 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1790895487.347284:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e003752d reply state 000000000abfc753 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895487.347301:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1790895487.347338:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf907a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347353:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.347361:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:2.0:1790895487.347364:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895487.347366:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e600, rc 0) 00000100:00100000:2.0:1790895487.347456:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11350:x1877889741028480:12345-192.168.201.54@tcp:101:bash.0 Request processed in 7084us (7485us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1790895487.347464:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 142 00010000:00010000:0.0:1790895487.351618:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.351638:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.351646:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.351658:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895487.351664:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.351679:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.351722:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310c7e300) 00010000:00010000:0.0:1790895487.351725:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895487.351730:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.351737:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9088 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895487.353575:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.354045:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741028608 00000100:00100000:0.0:1790895487.354055:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741028608 00000100:00080000:1.0:1790895487.354225:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790895487.354275:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:3.0:1790895487.354286:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889741028608:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895487.354303:0:8701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895487.354322:0:8701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ec0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895487.354358:0:8701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895487.354375:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1790895487.354380:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895487.354389:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 6 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.354405:0:8701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 6 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.354418:0:8701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167d000, rc 0) 00000100:00100000:3.0:1790895487.354523:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889741028608:12345-192.168.201.54@tcp:101:bash.0 Request processed in 239us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895487.354531:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:2.0:1790895487.359260:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.359375:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741028736 00000100:00100000:0.0:1790895487.359387:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741028736 00000100:00100000:0.0:1790895487.359461:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:0.0:1790895487.359473:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:11350:x1877889741028736:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895487.359496:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895487.359516:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ec7 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.359551:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 7 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.359561:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895487.359565:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895487.359569:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.359639:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 7 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.359695:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 7 pid: 8701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895487.359709:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33929ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1877889758860032:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895487.360117:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303e146c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895487.364811:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895487.364902:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741028864 00000100:00100000:3.0:1790895487.364921:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741028864 00010000:00010000:3.0:1790895487.364971:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 8 pid: 8701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895487.365022:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:3.0:1790895487.365034:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741028864:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895487.365050:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895487.365077:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 8 pid: 8701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.365107:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 8 pid: 8701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.365144:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895487.365149:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895487.365163:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.365175:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.365215:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895487.365229:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1877889758860160:192.168.201.54@tcp:105: 00000100:00100000:3.0:1790895487.365332:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919bd80 going to sleep for 11 seconds 00010000:00010000:0.0:1790895487.369978:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf909d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec0 expref: 8 pid: 8701 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895487.370013:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33929ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1877889758860032:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895487.370064:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.370084:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d600, rc 0) 00000100:00100000:1.0:1790895487.370417:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:11350:x1877889741028736:12345-192.168.201.54@tcp:101:bash.0 Request processed in 10944us (11556us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895487.370427:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:3.0:1790895487.372384:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1877889758860160:192.168.201.54@tcp:105: 00010000:00010000:3.0:1790895487.372413:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895487.372478:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889741028864:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 7445us (7677us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895487.372489:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:3.0:1790895487.379994:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895487.380086:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741029120 00000100:00100000:2.0:1790895487.380099:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741029120 00000100:00100000:2.0:1790895487.380187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:2.0:1790895487.380198:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11350:x1877889741029120:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:2.0:1790895487.380927:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11350:x1877889741029120:12345-192.168.201.54@tcp:35:bash.0 Request processed in 728us (955us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1790895487.380937:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:1.0:1790895487.486740:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895487.486833:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741029376 00000100:00100000:3.0:1790895487.486845:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741029376 00000100:00100000:2.0:1790895487.487822:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 143 00000100:00100000:2.0:1790895487.487839:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11360:x1877889741029376:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895487.487892:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895487.487931:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf90ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ece expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895487.488042:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1790895487.488183:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf90ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ece expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.488198:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:2.0:1790895487.488201:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790895487.488206:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf90ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ece expref: 21 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.488222:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fe00, rc 0) 00000100:00100000:2.0:1790895487.488289:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+20:11360:x1877889741029376:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 457us (1562us total) trans 4294967419 rc 301/301 00000100:00100000:2.0:1790895487.488298:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 143 00000100:00100000:3.0:1790895487.495379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.495541:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741029632 00000100:00100000:0.0:1790895487.495552:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741029632 00000100:00100000:0.0:1790895487.495611:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:0.0:1790895487.495623:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:11360:x1877889741029632:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:0.0:1790895487.495948:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11360:x1877889741029632:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 327us (581us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1790895487.495956:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:0.0:1790895487.699991:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895487.700147:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741029760 00000100:00100000:1.0:1790895487.700168:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741029760 00000100:00100000:1.0:1790895487.700231:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 144 00000100:00100000:1.0:1790895487.700242:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11366:x1877889741029760:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895487.700266:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895487.700286:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf90b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ed5 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.700620:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf90c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.700636:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.700648:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895487.700692:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790895487.700696:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895487.700714:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf90c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.700741:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf90b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ed5 expref: 23 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.700760:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf90c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ed5 expref: 22 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.700768:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895487.700784:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790895487.700787:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91cc00, rc 0) 00000100:00100000:1.0:1790895487.700948:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+22:11366:x1877889741029760:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 707us (966us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895487.700955:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 144 00010000:00010000:2.0:1790895487.709901:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895487.718924:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895487.719026:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741030016 00000100:00100000:2.0:1790895487.719036:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741030016 00000100:00100000:2.0:1790895487.719094:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 145 00000100:00100000:2.0:1790895487.719105:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+22:11366:x1877889741030016:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895487.719137:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895487.719169:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf90c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2edc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.719273:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf90ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.719287:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf90ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.719305:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf90ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895487.719317:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1790895487.719472:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf90c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2edc expref: 25 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.719490:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf90ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2edc expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.719499:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:2.0:1790895487.719502:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895487.719505:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84ec00, rc 0) 00000100:00100000:2.0:1790895487.719554:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+24:11366:x1877889741030016:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 452us (641us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1790895487.719568:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 145 00000100:00100000:3.0:1790895487.734920:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895487.735187:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741030400 00000100:00100000:2.0:1790895487.735197:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741030400 00000100:00100000:2.0:1790895487.735257:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:2.0:1790895487.735268:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+24:2362:x1877889741030400:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895487.735287:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895487.735315:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf90ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2edc expref: 24 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895487.735335:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:2.0:1790895487.735353:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895487.735423:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+23:2362:x1877889741030400:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 156us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895487.735430:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:1.0:1790895487.736115:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895487.745133:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741030272 00000100:00100000:3.0:1790895487.745264:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741030272 00000100:00100000:3.0:1790895487.745356:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 146 00000100:00100000:3.0:1790895487.745367:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+23:11366:x1877889741030272:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895487.745392:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895487.745415:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf90dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ee3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.745686:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf90e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.745702:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf90e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.745714:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf90e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895487.745726:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790895487.746640:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf90dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ee3 expref: 26 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.746678:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf90e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ee3 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.746689:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:3.0:1790895487.746692:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1790895487.746696:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ce00, rc 0) 00000100:00100000:3.0:1790895487.746810:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+25:11366:x1877889741030272:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1443us (10694us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1790895487.746819:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 146 00000100:00100000:1.0:1790895487.768334:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.768440:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741030528 00000100:00100000:0.0:1790895487.768449:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741030528 00000100:00100000:0.0:1790895487.768516:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:0.0:1790895487.768527:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2363:x1877889741030528:12345-192.168.201.54@tcp:1:lfs.0 00010000:00010000:0.0:1790895487.768575:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.768595:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.768604:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895487.768609:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895487.768614:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.768669:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.768698:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 6 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895487.768712:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33929f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758860288:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895487.768892:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303e146c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895487.779453:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895487.779968:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741030656 00000100:00100000:3.0:1790895487.779980:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741030656 00002000:00100000:3.0:1790895487.780042:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cf33a814a80 x1877889741030656/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:13/0 lens 504/0 e 0 to 0 dl 1790895498 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790895487.780054:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf33a814a80 with x1877889741030656 ext(0->12) 00010000:00010000:3.0:1790895487.780064:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 7 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.780093:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 7 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895487.780102:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf33a814a80 00000100:00100000:3.0:1790895487.780135:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:3.0:1790895487.780144:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741030656:12345-192.168.201.54@tcp:4:lfs.0 00000100:00100000:3.0:1790895487.780681:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a814a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2362:x1877889741030656:12345-192.168.201.54@tcp:4:lfs.0 Request processed in 535us (1236us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1790895487.780696:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00002000:00100000:3.0:1790895487.780703:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8cf33a814a80 x1877889741030656/t4294967305(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:13/0 lens 504/448 e 0 to 0 dl 1790895498 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1790895487.780712:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf33a814a80 with x1877889741030656 ext(0->12) 00010000:00010000:3.0:1790895487.780728:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 9 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.780746:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 9 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895487.780754:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf33a814a80 00000100:00100000:0.0:1790895487.783422:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33929f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758860288:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895487.783469:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895487.785217:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.785326:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741030784 00000100:00100000:0.0:1790895487.785352:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741030784 00010000:00010000:0.0:1790895487.785393:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 9 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895487.785442:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:0.0:1790895487.785452:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2361:x1877889741030784:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895487.785486:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790895487.785507:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790895487.785510:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1790895487 00002000:00010000:0.0:1790895487.785513:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1790895488 00002000:00010000:0.0:1790895487.785515:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1790895487 00010000:00010000:0.0:1790895487.785522:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 9 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.785550:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 9 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.785587:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028976300/0x7911a98710cf90a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ec7 expref: 9 pid: 6688 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.785606:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895487.785610:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895487.785616:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.785627:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.785676:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895487.786002:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741030784:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 550us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895487.786011:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 62 00010000:00010000:1.0:1790895487.787879:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.787899:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.787935:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.787944:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.787953:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.787961:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895487.787965:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.787991:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.788008:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.788016:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6faa0a0/0x7911a98710cf90f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895487.788111:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889741030528:12345-192.168.201.54@tcp:1:lfs.0 Request processed in 19584us (19784us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895487.788121:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:2.0:1790895487.793513:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.793740:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741031040 00000100:00100000:0.0:1790895487.793761:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741031040 00000100:00100000:0.0:1790895487.793818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:0.0:1790895487.793829:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+25:11366:x1877889741031040:12345-192.168.201.54@tcp:35:lfs.0 00000004:00010000:0.0:1790895487.793936:0:5835:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf90e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ee3 expref: 25 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895487.794548:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1790895487.794735:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1790895487.797429:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1790895487.798365:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.798396:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.798406:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.801547:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.802227:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 29 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895487.802268:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33929f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1877889758860416:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895487.802393:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf303e146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895487.816222:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33929f100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5835:1877889758860416:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895487.816255:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895487.818990:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895487.819505:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741031168 00000100:00100000:3.0:1790895487.819516:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741031168 00010000:00010000:3.0:1790895487.819570:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 30 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895487.819609:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:3.0:1790895487.819619:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+30:2362:x1877889741031168:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895487.819635:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895487.819642:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 30 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.819679:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 30 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.819703:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf908f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb9 expref: 30 pid: 5832 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.819737:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:3.0:1790895487.819743:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.819752:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.819759:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895487.819798:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895487.819896:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+29:2362:x1877889741031168:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 278us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895487.819904:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 63 00010000:00010000:1.0:1790895487.820257:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895487.820267:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895487.820420:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1790895487.820768:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1790895487.820938:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758860544:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790895487.821222:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895487.821259:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da900 going to sleep for 11 seconds 00000100:00100000:3.0:1790895487.822248:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758860544 00000100:00100000:3.0:1790895487.822258:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758860544 00000100:00080000:1.0:1790895487.822502:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1790895487.823213:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1790895487.823230:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877889758860544:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1790895487.823707:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5835:x1877889758860544:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 482us (2484us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895487.823715:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790895487.823826:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758860544:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790895487.827549:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1790895487.827685:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758860672:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1790895487.827752:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895487.845098:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895487.849263:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758860672 00000100:00100000:2.0:1790895487.849281:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758860672 00000100:00100000:2.0:1790895487.849350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790895487.849361:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5835:x1877889758860672:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1790895487.851755:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5835:x1877889758860672:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 2387us (23992us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1790895487.851768:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1790895487.851821:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5835:1877889758860672:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1790895487.851932:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1790895487.852019:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.852030:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.852037:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.852043:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895487.852048:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.852056:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.852073:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:0.0:1790895487.852084:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1790895487.852090:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.852096:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf90f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790895487.852341:0:5835:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1790895487.852497:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:0.0:1790895487.852512:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360819653771ns, next at 361819650487ns, rc = 0 00000001:00080000:0.0:1790895487.852520:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1790895487.852567:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310c7ee00) 00010000:00010000:0.0:1790895487.852570:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1790895487.852578:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf90e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ee3 expref: 33 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895487.852700:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+32:11366:x1877889741031040:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 58872us (59198us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1790895487.852710:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 38 00000020:00080000:0.0:1790895487.852714:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790895487.860541:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.860643:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741031296 00000100:00100000:0.0:1790895487.860654:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741031296 00000100:00100000:0.0:1790895487.860722:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 147 00000100:00100000:0.0:1790895487.860732:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+32:11366:x1877889741031296:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895487.860759:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895487.860794:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf90ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2eea expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.860890:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf90ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eea expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.860907:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf90ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eea expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895487.860947:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:0.0:1790895487.860950:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895487.860954:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895487.861970:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+33:11366:x1877889741031296:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 338us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895487.861989:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 147 00000100:00100000:2.0:1790895487.865848:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.866463:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741031552 00000100:00100000:0.0:1790895487.866475:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741031552 00000100:00100000:0.0:1790895487.866545:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:0.0:1790895487.866654:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+33:11366:x1877889741031552:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:0.0:1790895487.867094:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+34:11366:x1877889741031552:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 538us (1257us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1790895487.867102:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:2.0:1790895487.884991:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895487.885034:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895487.885068:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895487.885245:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741031680 00000100:00100000:0.0:1790895487.885255:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741031680 00000100:00100000:0.0:1790895487.885320:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 290 00000100:00100000:0.0:1790895487.885330:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889741031680:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895487.885408:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2364:x1877889741031680:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 79us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895487.885416:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 290 00000100:00100000:1.0:1790895487.885829:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741031936 00000100:00100000:1.0:1790895487.885834:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741031936 00000100:00100000:1.0:1790895487.885913:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 142 00000100:00100000:1.0:1790895487.885921:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889741031936:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895487.885958:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2364:x1877889741031936:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 39us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895487.885964:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 142 00000100:00080000:1.0:1790895487.885981:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895487.886120:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741031808 00000100:00100000:3.0:1790895487.886125:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741031808 00000100:00100000:3.0:1790895487.886208:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 71 00000100:00100000:3.0:1790895487.886216:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889741031808:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895487.886250:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889741031808:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 37us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895487.886273:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 71 00000100:00080000:1.0:1790895487.886583:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895488.077425:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895488.077558:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741032192 00000100:00100000:1.0:1790895488.077568:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741032192 00000100:00100000:1.0:1790895488.077632:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 148 00000100:00100000:1.0:1790895488.077643:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+34:11377:x1877889741032192:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895488.077679:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895488.077704:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ef1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895488.077806:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790895488.078638:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9106 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef1 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.078666:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:1.0:1790895488.078684:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790895488.078692:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef1 expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.078709:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ce00, rc 0) 00000100:00100000:1.0:1790895488.078840:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11377:x1877889741032192:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1197us (1541us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1790895488.078847:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 148 00000100:00100000:2.0:1790895488.089987:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895488.090320:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741032320 00000100:00100000:1.0:1790895488.090332:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741032320 00000100:00100000:1.0:1790895488.090396:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 149 00000100:00100000:1.0:1790895488.090408:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11377:x1877889741032320:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:1.0:1790895488.090491:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090506:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090516:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090527:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090532:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090536:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090624:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090663:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090671:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895488.090713:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090727:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090733:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090739:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090745:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895488.090749:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090755:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090766:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895488.090769:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895488.090774:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090779:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9114 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090802:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090808:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090814:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090819:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895488.090823:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090829:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090836:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310cb5f00) 00010000:00010000:1.0:1790895488.090842:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895488.090848:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090853:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf911b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.090903:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.091088:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.091093:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.091105:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895488.091108:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.091115:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.091123:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:1.0:1790895488.091126:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895488.091129:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.091236:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9122 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895488.091555:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11377:x1877889741032320:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 1148us (1588us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895488.091562:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 149 00000100:00100000:2.0:1790895488.104598:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895488.104810:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741032576 00000100:00100000:3.0:1790895488.104820:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741032576 00000100:00100000:3.0:1790895488.104914:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:3.0:1790895488.104925:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11377:x1877889741032576:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:3.0:1790895488.105411:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+36:11377:x1877889741032576:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 487us (821us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1790895488.105419:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:0.0:1790895488.177636:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895488.177753:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741032832 00000100:00100000:1.0:1790895488.177765:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741032832 00000100:00100000:1.0:1790895488.177829:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 150 00000100:00100000:1.0:1790895488.177840:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+36:11380:x1877889741032832:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895488.177886:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895488.177918:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9129 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ef8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.177993:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178026:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178037:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178054:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178060:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178066:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178365:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178375:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178382:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895488.178391:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790895488.178483:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178493:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178500:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178512:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895488.178516:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178524:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178537:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895488.178540:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895488.178545:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178552:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9130 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178566:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178573:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178579:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178585:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895488.178588:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178594:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178612:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310cb5f00) 00010000:00010000:1.0:1790895488.178614:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895488.178617:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178623:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178675:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9129 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 39 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178689:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 38 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.178696:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:1.0:1790895488.178698:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895488.178700:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ce00, rc 0) 00000100:00100000:1.0:1790895488.178772:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+38:11380:x1877889741032832:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 933us (1145us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1790895488.178779:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 150 00000100:00100000:0.0:1790895488.189114:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895488.189418:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741032960 00000100:00100000:3.0:1790895488.189428:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741032960 00000100:00100000:3.0:1790895488.189485:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 151 00000100:00100000:3.0:1790895488.189495:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+38:11380:x1877889741032960:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:3.0:1790895488.189561:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189578:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189590:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189618:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189626:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189633:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189650:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895488.189668:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189677:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189692:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895488.189695:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895488.189700:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.189705:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf914c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895488.189781:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+38:11380:x1877889741032960:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 287us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895488.189788:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 151 00000100:00100000:3.0:1790895488.195271:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895488.195573:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741033216 00000100:00100000:2.0:1790895488.195585:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741033216 00000100:00100000:2.0:1790895488.195651:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:2.0:1790895488.195673:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+38:11380:x1877889741033216:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895488.196295:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+39:11380:x1877889741033216:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 624us (1031us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1790895488.196331:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 41 00000001:00080000:0.0:1790895488.546671:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:0.0:1790895488.546820:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1790895488.592447:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895488.604571:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741033472 00000100:00100000:1.0:1790895488.604588:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741033472 00000100:00100000:1.0:1790895488.604676:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 152 00000100:00100000:1.0:1790895488.604685:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+39:11411:x1877889741033472:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:1.0:1790895488.604715:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895488.604734:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9153 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2eff expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.604889:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf915a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.604902:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf915a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.604911:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf915a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895488.604920:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1790895488.605022:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9153 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eff expref: 42 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.605044:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf915a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eff expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.605051:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:1.0:1790895488.605054:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895488.605057:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c600, rc 0) 00000100:00100000:1.0:1790895488.605146:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+41:11411:x1877889741033472:12345-192.168.201.54@tcp:101:cat.0 Request processed in 461us (12708us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1790895488.605154:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 152 00000100:00100000:1.0:1790895488.618328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895488.618399:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741033600 00000100:00100000:0.0:1790895488.618410:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741033600 00000100:00100000:1.0:1790895488.618441:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895488.618479:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:0.0:1790895488.618487:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+41:2362:x1877889741033600:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895488.618500:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895488.618521:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf915a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eff expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895488.618537:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:0.0:1790895488.618540:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895488.618587:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+40:2362:x1877889741033600:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 100us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895488.618592:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741033856 00000100:00100000:0.0:1790895488.618596:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:2.0:1790895488.618599:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741033856 00000100:00100000:2.0:1790895488.618644:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:2.0:1790895488.618663:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+40:11411:x1877889741033856:12345-192.168.201.54@tcp:35:cat.0 00000100:00100000:2.0:1790895488.618948:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+41:11411:x1877889741033856:12345-192.168.201.54@tcp:35:cat.0 Request processed in 285us (506us total) trans 4294967438 rc 0/0 00000100:00100000:2.0:1790895488.618955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:3.0:1790895488.703213:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895488.703336:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741034112 00000100:00100000:1.0:1790895488.703349:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741034112 00000100:00100000:1.0:1790895488.703464:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 153 00000100:00100000:1.0:1790895488.703475:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+41:11417:x1877889741034112:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1790895488.703518:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895488.703522:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790895488.703546:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf90c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ed5 expref: 41 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.703566:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895488.703571:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895488.703584:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9168 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f06 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.703711:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.703728:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.703738:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.703770:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 41 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895488.703799:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 41 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895488.703815:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758860800:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895488.703968:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895488.706731:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758860800:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895488.706765:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895488.707833:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895488.708231:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741034240 00000100:00100000:2.0:1790895488.708243:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741034240 00010000:00010000:2.0:1790895488.708287:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 42 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895488.708319:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:2.0:1790895488.708329:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306505050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+42:2362:x1877889741034240:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895488.708345:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895488.708352:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 42 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895488.708379:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 42 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895488.708404:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf913e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ef8 expref: 42 pid: 5831 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895488.708424:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:2.0:1790895488.708443:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895488.708454:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895488.708464:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895488.708488:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895488.708547:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306505050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+41:2362:x1877889741034240:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 218us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895488.708555:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 64 00010000:00010000:3.0:1790895488.708900:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.708909:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895488.708937:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1790895488.709109:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9168 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 42 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.709126:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 41 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.709133:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895488.709136:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790895488.709138:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d000, rc 0) 00000100:00100000:3.0:1790895488.709175:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+41:11417:x1877889741034112:12345-192.168.201.54@tcp:101:dd.0 Request processed in 5702us (5974us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1790895488.709193:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 153 00000100:00100000:3.0:1790895488.714064:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895488.714140:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741034496 00000100:00100000:0.0:1790895488.714150:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741034496 00000100:00100000:0.0:1790895488.714546:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 154 00000100:00100000:0.0:1790895488.714559:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+41:11417:x1877889741034496:12345-192.168.201.54@tcp:36:dd.0 00010000:00010000:0.0:1790895488.715093:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895488.715113:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895488.715126:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895488.715178:0:5831:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1790895488.715219:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007eb1a4e2 reply state 00000000327a5410 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895488.715242:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790895488.715343:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+44:11417:x1877889741034496:12345-192.168.201.54@tcp:36:dd.0 Request processed in 787us (1289us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1790895488.715350:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 154 00000020:00080000:0.0:1790895488.715356:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790895488.717626:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.717653:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.717662:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.717668:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895488.717673:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.717681:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.717727:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895488.717731:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895488.717736:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895488.717742:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf917d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895488.728128:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895489.058219:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895489.058908:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741034624 00000100:00100000:1.0:1790895489.058935:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741034624 00000100:00100000:1.0:1790895489.059014:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 155 00000100:00100000:1.0:1790895489.059027:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+43:11431:x1877889741034624:12345-192.168.201.54@tcp:101:stat.0 00010000:00010000:1.0:1790895489.059060:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895489.059082:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9184 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f0d expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059173:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059187:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059202:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059217:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059224:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059230:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059331:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059342:0:7639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059350:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059391:0:7639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.059433:0:7639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 44 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895489.059448:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758860928:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895489.059550:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da3c0 going to sleep for 11 seconds 00000100:00080000:2.0:1790895489.060333:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895489.066210:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895489.068572:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741034880 00000100:00100000:0.0:1790895489.068595:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741034880 00000100:00100000:0.0:1790895489.068691:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:0.0:1790895489.068704:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+45:5599:x1877889741034880:12345-192.168.201.54@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1790895489.069123:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+46:5599:x1877889741034880:12345-192.168.201.54@tcp:35:ldlm_bl.0 Request processed in 421us (2922us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1790895489.069131:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:3.0:1790895489.074929:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758860928:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895489.074963:0:7639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895489.075214:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.081578:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741035008 00000100:00100000:3.0:1790895489.081599:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741035008 00010000:00010000:3.0:1790895489.081670:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 46 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895489.081807:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 65 00000100:00100000:3.0:1790895489.081819:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+46:2361:x1877889741035008:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895489.081839:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895489.081847:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 46 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.081894:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 46 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.081919:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf916f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f06 expref: 46 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.081957:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.081963:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.081973:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.081981:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.082027:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895489.082108:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+45:2361:x1877889741035008:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 292us (6895us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895489.082116:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 65 00010000:00010000:1.0:1790895489.082190:0:7639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082199:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895489.082251:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1790895489.082257:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895489.082278:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082291:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082311:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082319:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082326:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082340:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895489.082344:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082351:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082361:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895489.082364:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895489.082368:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082375:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf918b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082386:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082392:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082411:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082417:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895489.082419:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082425:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082442:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310cb5a00) 00010000:00010000:1.0:1790895489.082445:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895489.082448:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082455:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9192 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082489:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9184 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f0d expref: 45 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082502:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f0d expref: 44 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.082509:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:1.0:1790895489.082511:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895489.082513:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91cc00, rc 0) 00000100:00100000:1.0:1790895489.082540:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+44:11431:x1877889741034624:12345-192.168.201.54@tcp:101:stat.0 Request processed in 23518us (24333us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895489.082547:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 155 00000100:00100000:1.0:1790895489.138717:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895489.138821:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741035264 00000100:00100000:2.0:1790895489.138833:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741035264 00000100:00100000:2.0:1790895489.138940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 156 00000100:00100000:2.0:1790895489.138951:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+44:11437:x1877889741035264:12345-192.168.201.54@tcp:36:truncate.0 00010000:00010000:2.0:1790895489.139014:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895489.139051:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9199 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f0d expref: 44 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.139069:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:2.0:1790895489.139074:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895489.139273:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.139286:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.139311:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790895489.139349:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1790895489.139366:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c06a4f37 reply state 00000000000475a0 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895489.139373:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1790895489.139469:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+46:11437:x1877889741035264:12345-192.168.201.54@tcp:36:truncate.0 Request processed in 521us (764us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1790895489.139474:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 156 00000020:00080000:2.0:1790895489.139479:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790895489.140977:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.140993:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.141001:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.141008:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ea00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895489.141013:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.141022:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.141046:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.141049:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895489.141055:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.141062:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf91a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895489.278751:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.278927:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741035392 00000100:00100000:3.0:1790895489.278942:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741035392 00000100:00100000:3.0:1790895489.279005:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 157 00000100:00100000:3.0:1790895489.279016:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+45:11451:x1877889741035392:12345-192.168.201.54@tcp:101:stat.0 00010000:00010000:3.0:1790895489.279044:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895489.279067:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf91a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f14 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279170:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279189:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279201:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279218:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279225:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279252:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279345:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279351:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279356:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895489.279388:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1790895489.279391:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895489.279410:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279418:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279424:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279428:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279432:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279436:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895489.279439:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279449:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279459:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895489.279461:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895489.279465:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279469:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279480:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279484:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279487:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279490:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895489.279492:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279495:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279498:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895489.279500:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895489.279501:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279510:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf91a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 47 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279546:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.279550:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.279552:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790895489.279554:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895489.279613:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+46:11451:x1877889741035392:12345-192.168.201.54@tcp:101:stat.0 Request processed in 599us (873us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895489.279620:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 157 00000100:00100000:2.0:1790895489.360298:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895489.360410:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741035648 00000100:00100000:0.0:1790895489.360423:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741035648 00000100:00100000:0.0:1790895489.360495:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 158 00000100:00100000:0.0:1790895489.360506:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+46:11461:x1877889741035648:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895489.360536:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895489.360559:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf91c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f1b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895489.360703:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1790895489.360840:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf91c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f1b expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.361102:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:0.0:1790895489.361105:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895489.361112:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf91c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f1b expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.361223:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895489.361329:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+47:11461:x1877889741035648:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 824us (1041us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1790895489.361336:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 158 00000100:00100000:0.0:1790895489.365252:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895489.365358:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741035904 00000100:00100000:2.0:1790895489.365370:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741035904 00000100:00100000:2.0:1790895489.365469:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:2.0:1790895489.365480:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+47:11461:x1877889741035904:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895489.365768:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+48:11461:x1877889741035904:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 289us (525us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1790895489.365776:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:1.0:1790895489.420944:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.421028:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741036160 00000100:00100000:3.0:1790895489.421038:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741036160 00000100:00100000:3.0:1790895489.421095:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 159 00000100:00100000:3.0:1790895489.421106:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+48:11467:x1877889741036160:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895489.421153:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895489.421175:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf91d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f22 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.421276:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.421289:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.421312:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.421341:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.421369:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 49 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895489.421383:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758861056:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895489.421459:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3059636c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895489.425219:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895489.425365:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741036288 00000100:00100000:0.0:1790895489.425381:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741036288 00010000:00010000:0.0:1790895489.425434:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 50 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895489.425478:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00100000:0.0:1790895489.425489:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+50:2362:x1877889741036288:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895489.425507:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895489.425514:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 50 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.425540:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 50 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.425566:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:0.0:1790895489.425584:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.425593:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.425601:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.425620:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895489.425699:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+50:2362:x1877889741036288:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 202us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895489.425707:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 66 00010000:00010000:3.0:1790895489.426008:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf91bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f14 expref: 49 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895489.426028:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758861056:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895489.426052:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.426063:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.426070:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895489.426092:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1790895489.426300:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf91d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 50 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.426334:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 49 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.426342:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.426345:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790895489.426348:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167d000, rc 0) 00000100:00100000:3.0:1790895489.426384:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+49:11467:x1877889741036160:12345-192.168.201.54@tcp:101:bash.0 Request processed in 5280us (5449us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1790895489.426391:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 159 00000100:00100000:0.0:1790895489.429769:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895489.429907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741036544 00000100:00100000:1.0:1790895489.429919:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741036544 00000100:00100000:1.0:1790895489.430025:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 160 00000100:00100000:1.0:1790895489.430036:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+49:11467:x1877889741036544:12345-192.168.201.54@tcp:36:bash.0 00010000:00010000:1.0:1790895489.430397:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.430421:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.430436:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895489.430495:0:5831:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1790895489.430519:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006577043c reply state 00000000a9e7b092 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895489.430529:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895489.430651:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+52:11467:x1877889741036544:12345-192.168.201.54@tcp:36:bash.0 Request processed in 616us (893us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1790895489.430659:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 160 00000020:00080000:1.0:1790895489.430666:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790895489.435243:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.435265:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.435274:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.435282:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895489.435288:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.435297:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.435320:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.435324:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895489.435330:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.435357:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf91e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895489.436192:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.436228:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741036672 00000100:00100000:3.0:1790895489.436240:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741036672 00000100:00100000:3.0:1790895489.436310:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 161 00000100:00100000:3.0:1790895489.436323:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+51:11467:x1877889741036672:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895489.436360:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895489.436389:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f29 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.436507:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.436521:0:7639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.436530:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.436565:0:7639:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 52 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.436594:0:7639:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 52 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895489.436608:0:7639:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758861184:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895489.436714:0:7639:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305963900 going to sleep for 11 seconds 00000100:00100000:3.0:1790895489.439763:0:7639:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7639:1877889758861184:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895489.439795:0:7639:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895489.440792:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895489.441059:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741036800 00000100:00100000:2.0:1790895489.441068:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741036800 00010000:00010000:2.0:1790895489.441132:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 53 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895489.441172:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 67 00000100:00100000:2.0:1790895489.441183:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+53:2362:x1877889741036800:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895489.441221:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895489.441228:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 53 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.441257:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 53 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.441282:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf91d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f22 expref: 53 pid: 5832 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.441304:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:2.0:1790895489.441309:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.441320:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.441328:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.441364:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895489.441430:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+52:2362:x1877889741036800:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 248us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895489.441438:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 67 00010000:00010000:0.0:1790895489.442143:0:7639:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.442155:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895489.442208:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1790895489.442214:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895489.442245:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.442289:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf91ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f29 expref: 52 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.442314:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f29 expref: 51 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.442336:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:0.0:1790895489.442339:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895489.442341:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167da00, rc 0) 00000100:00100000:0.0:1790895489.442387:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+51:11467:x1877889741036672:12345-192.168.201.54@tcp:101:bash.0 Request processed in 6067us (6203us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895489.442394:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 161 00000100:00100000:0.0:1790895489.446374:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.446461:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741037056 00000100:00100000:3.0:1790895489.446472:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741037056 00000100:00100000:3.0:1790895489.446555:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:3.0:1790895489.446567:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+51:11467:x1877889741037056:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:3.0:1790895489.446960:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+52:11467:x1877889741037056:12345-192.168.201.54@tcp:35:bash.0 Request processed in 394us (599us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1790895489.446969:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:3.0:1790895489.496157:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758861312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895489.496244:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895489.496472:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758861312 00000100:00100000:0.0:1790895489.496481:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758861312 00000100:00100000:0.0:1790895489.496559:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790895489.496570:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758861312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895489.496613:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895489.496680:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758861312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895489.496687:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790895489.496725:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758861440:0@lo:400:kworker.0 00000100:00100000:1.0:1790895489.496741:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758861568:0@lo:400:kworker.0 00000100:00100000:0.0:1790895489.496757:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895489.496771:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895489.496781:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758861952:0@lo:400:kworker.0 00000100:00100000:1.0:1790895489.496799:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758861696:0@lo:400:kworker.0 00000100:00100000:0.0:1790895489.496803:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895489.496820:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895489.496839:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758861568 00000100:00100000:1.0:1790895489.496841:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1790895489.496843:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758861568 00000100:00100000:1.0:1790895489.496846:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758861824:0@lo:400:kworker.0 00000100:00100000:1.0:1790895489.496882:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895489.496961:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758861440 00000100:00100000:3.0:1790895489.496965:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758861440 00000100:00100000:3.0:1790895489.496996:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790895489.497002:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758861440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895489.497041:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758861440:12345-0@lo:400:kworker.0 Request processed in 39us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895489.497047:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1790895489.497075:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758861952 00000100:00100000:3.0:1790895489.497079:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758861952 00000100:00100000:0.0:1790895489.502066:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758861696 00000100:00100000:0.0:1790895489.502089:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758861696 00000100:00100000:1.0:1790895489.503978:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758861824 00000100:00100000:1.0:1790895489.504006:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758861824 00000100:00100000:0.0:1790895489.504435:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00080000:2.0:1790895489.504504:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895489.506047:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790895489.506076:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758861952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895489.506249:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758861952:12345-0@lo:400:kworker.0 Request processed in 187us (9444us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895489.506284:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1790895489.506371:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:3.0:1790895489.506381:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:3.0:1790895489.506414:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758861952:0@lo:400:kworker.0 00000100:00100000:3.0:1790895489.506430:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758861440:0@lo:400:kworker.0 00000100:00100000:3.0:1790895489.506472:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1790895489.506478:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf33f9a1180, transno 4294967312 00000100:00100000:3.0:1790895489.506507:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758861312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895489.506961:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1790895489.510744:0:7639:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790895489.510770:0:7639:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1790895489.510930:0:5832:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1790895489.510953:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790895489.510970:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758861824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895489.511327:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1877889758861824:12345-0@lo:400:kworker.0 Request processed in 361us (14441us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895489.511336:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1790895489.511408:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3310:1877889758861824:0@lo:400:kworker.0 00000100:00100000:0.0:1790895489.515218:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758861568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895489.515420:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758861568:12345-0@lo:400:kworker.0 Request processed in 10972us (18646us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895489.515435:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1790895489.515455:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758861568:0@lo:400:kworker.0 00000100:00080000:2.0:1790895489.515775:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895489.515781:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895489.516039:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758861696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895489.516316:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758861696:12345-0@lo:400:kworker.0 Request processed in 9343us (19493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895489.516325:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1790895489.518038:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758861696:0@lo:400:kworker.0 00000100:00100000:2.0:1790895489.547042:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895489.547449:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741037312 00000100:00100000:1.0:1790895489.547461:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741037312 00000100:00100000:1.0:1790895489.547569:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 162 00000100:00100000:1.0:1790895489.547581:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+52:11477:x1877889741037312:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895489.547609:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895489.547652:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf91fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f30 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895489.548360:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790895489.548519:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf91fb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f30 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.548536:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:1.0:1790895489.548539:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790895489.548545:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf91fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f30 expref: 54 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.548577:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c600, rc 0) 00000100:00100000:1.0:1790895489.548768:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+53:11477:x1877889741037312:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1188us (1736us total) trans 4294967451 rc 301/301 00000100:00100000:1.0:1790895489.548777:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 162 00000100:00100000:2.0:1790895489.552215:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895489.553144:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741037440 00000100:00100000:0.0:1790895489.553159:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741037440 00000100:00100000:0.0:1790895489.553233:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 163 00000100:00100000:0.0:1790895489.553246:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3077abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+53:11477:x1877889741037440:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:0.0:1790895489.553334:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553353:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553366:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553383:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553389:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553396:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553499:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553508:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553538:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895489.553601:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553641:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553647:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553653:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553659:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895489.553663:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553671:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.553684:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895489.553687:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895489.554070:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554080:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9209 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554100:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554126:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554133:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554137:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895489.554140:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554147:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554155:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf31037c400) 00010000:00010000:0.0:1790895489.554158:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895489.554160:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554165:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9210 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554180:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554186:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554192:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554197:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895489.554206:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554212:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554220:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:0.0:1790895489.554222:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895489.554225:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895489.554231:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9217 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895489.554556:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3077abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+53:11477:x1877889741037440:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 1311us (2351us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895489.554567:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 163 00000100:00100000:0.0:1790895489.558381:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895489.558641:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741037696 00000100:00100000:1.0:1790895489.558653:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741037696 00000100:00100000:1.0:1790895489.558734:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:1.0:1790895489.558745:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+53:11477:x1877889741037696:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895489.559050:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+54:11477:x1877889741037696:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 306us (685us total) trans 4294967452 rc 0/0 00000100:00100000:1.0:1790895489.559058:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:0.0:1790895489.602474:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.602664:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741037952 00000100:00100000:3.0:1790895489.602675:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741037952 00000100:00100000:3.0:1790895489.602752:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 164 00000100:00100000:3.0:1790895489.602764:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+54:11480:x1877889741037952:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895489.602794:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895489.602818:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf921e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f37 expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603300:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603318:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603330:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603360:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603368:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603374:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603493:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9233 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603503:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603511:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9233 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895489.603521:0:12417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1790895489.603627:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603648:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603655:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603661:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895489.603666:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603684:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603851:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895489.603876:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895489.603882:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603890:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9225 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603973:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603981:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603988:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.603993:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895489.603996:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.604003:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.604011:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895489.604014:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895489.604016:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.604033:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf922c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.604090:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf921e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f37 expref: 57 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.604236:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9233 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f37 expref: 56 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.604247:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.604250:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790895489.604253:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ce00, rc 0) 00000100:00100000:3.0:1790895489.604409:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11480:x1877889741037952:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1647us (1945us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1790895489.604420:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 164 00000100:00100000:0.0:1790895489.613911:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.614033:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741038080 00000100:00100000:3.0:1790895489.614043:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741038080 00000100:00100000:3.0:1790895489.614104:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 165 00000100:00100000:3.0:1790895489.614114:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11480:x1877889741038080:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:3.0:1790895489.614190:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614212:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614225:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614274:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614281:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614288:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614295:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895489.614299:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614307:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614320:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.614323:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895489.614328:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.614334:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9241 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895489.614429:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11480:x1877889741038080:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 316us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895489.614436:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 165 00000100:00100000:0.0:1790895489.618577:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895489.618643:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.618788:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741038464 00000100:00100000:3.0:1790895489.618804:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741038464 00000100:00100000:3.0:1790895489.618964:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1790895489.619006:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+56:2364:x1877889741038464:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895489.619035:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895489.619075:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9233 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f37 expref: 56 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.619108:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:3.0:1790895489.619115:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895489.619455:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+55:2364:x1877889741038464:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 454us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895489.619464:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:1.0:1790895489.620089:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741038336 00000100:00100000:1.0:1790895489.620100:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741038336 00000100:00100000:1.0:1790895489.620157:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:1.0:1790895489.620168:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+55:11480:x1877889741038336:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895489.620474:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11480:x1877889741038336:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 307us (1916us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1790895489.620483:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00010000:00010000:0.0:1790895489.752318:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895489.784007:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895489.784147:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741038720 00000100:00100000:2.0:1790895489.784160:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741038720 00000100:00100000:2.0:1790895489.784234:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 166 00000100:00100000:2.0:1790895489.784246:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11498:x1877889741038720:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:2.0:1790895489.784280:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895489.784310:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9248 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f3e expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.784433:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf924f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.784450:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf924f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.784465:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf924f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895489.784478:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1790895489.784642:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9248 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f3e expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.784665:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf924f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f3e expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.784674:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:2.0:1790895489.784677:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1790895489.784682:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fe00, rc 0) 00000100:00100000:2.0:1790895489.784769:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+58:11498:x1877889741038720:12345-192.168.201.54@tcp:101:cat.0 Request processed in 525us (776us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1790895489.784792:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 166 00000100:00100000:0.0:1790895489.810060:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895489.810449:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741038848 00000100:00100000:3.0:1790895489.810459:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741038848 00000100:00100000:3.0:1790895489.810519:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 167 00000100:00100000:3.0:1790895489.810530:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+58:11499:x1877889741038848:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895489.810555:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895489.810580:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf925d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f45 expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.810667:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.810682:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.810706:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895489.810747:0:12417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1790895489.810766:0:12417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895489.810789:0:12417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.810816:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf925d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f45 expref: 60 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.810838:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f45 expref: 59 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895489.810848:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895489.810851:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895489.810855:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167de00, rc 0) 00000100:00100000:3.0:1790895489.811084:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+59:11499:x1877889741038848:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 555us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895489.811091:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 167 00000100:00100000:3.0:1790895489.819917:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895489.820141:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741039232 00000100:00100000:1.0:1790895489.820156:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741039232 00000100:00100000:1.0:1790895489.820231:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:1.0:1790895489.820241:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+59:11499:x1877889741039232:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895489.820636:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+60:11499:x1877889741039232:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 387us (780us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1790895489.820663:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:1.0:1790895489.824021:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895489.824289:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741039360 00000100:00100000:2.0:1790895489.824305:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741039360 00000100:00100000:2.0:1790895489.824385:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:2.0:1790895489.824399:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+60:11499:x1877889741039360:12345-192.168.201.54@tcp:103:lfs.0 00010000:00010000:2.0:1790895489.824422:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1790895489.824455:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf91f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f29 expref: 60 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.824486:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf924f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f3e expref: 59 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.824500:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf90ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eea expref: 58 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.824511:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037ce00) 00010000:00010000:2.0:1790895489.824525:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895489.824604:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11499:x1877889741039360:12345-192.168.201.54@tcp:103:lfs.0 Request processed in 209us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895489.824612:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:0.0:1790895489.827077:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895489.827184:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741039488 00000100:00100000:1.0:1790895489.827195:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741039488 00000100:00100000:1.0:1790895489.827254:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 168 00000100:00100000:1.0:1790895489.827265:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11499:x1877889741039488:12345-192.168.201.54@tcp:58:lfs.0 00010000:00010000:1.0:1790895489.827411:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.827431:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895489.827446:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790895489.827721:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1790895489.827819:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11499:x1877889741039488:12345-192.168.201.54@tcp:58:lfs.0 Request processed in 554us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895489.827827:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 168 00000100:00100000:0.0:1790895489.852989:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895489.853094:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741039616 00000100:00100000:2.0:1790895489.853105:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741039616 00000100:00100000:2.0:1790895489.853176:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 169 00000100:00100000:2.0:1790895489.853188:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11501:x1877889741039616:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895489.853215:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895489.853241:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf9272 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f4c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853336:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853352:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853365:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853381:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853388:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853394:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853484:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853494:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853500:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895489.853532:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1790895489.853537:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895489.853556:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853579:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853588:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853595:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853601:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853608:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ec00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895489.853612:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853620:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853643:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:2.0:1790895489.853647:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895489.853652:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853659:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ec00/0x7911a98710cf9279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853674:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853681:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853693:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853698:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895489.853701:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853708:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853719:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310c7ec00) 00010000:00010000:2.0:1790895489.853722:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895489.853724:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853729:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f600/0x7911a98710cf9280 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853760:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fe00/0x7911a98710cf9272 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853774:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895489.853781:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310cb5a00) 00010000:00010000:2.0:1790895489.853783:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895489.853786:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e600, rc 0) 00000100:00100000:2.0:1790895489.854379:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+58:11501:x1877889741039616:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 672us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895489.854399:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 169 00000004:00080000:1.0:1790895490.009613:0:7922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 362976751808ns, next at 363976748714ns, rc = 0 00000100:00100000:1.0:1790895490.009661:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758862080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790895490.009749:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895490.009891:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758862080 00000100:00100000:1.0:1790895490.009900:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758862080 00000100:00100000:1.0:1790895490.009955:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790895490.009965:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758862080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790895490.010008:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895490.010069:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758862080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895490.010351:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790895490.010401:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758862080:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1790895490.105608:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967445 is committed 00000004:00080000:0.0:1790895490.105644:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:0.0:1790895490.105675:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:0.0:1790895490.105693:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000020:00080000:0.0:1790895490.105722:0:5854:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf3180da900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1790895490.105727:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf306036800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf3180da540 00000020:00080000:0.0:1790895490.105730:0:5854:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf306036900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf3368b0400 00000020:00080000:0.0:1790895490.105800:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1790895490.106224:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895490.106246:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758862208:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790895490.106319:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895490.106395:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758862208 00000100:00100000:3.0:1790895490.106403:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758862208 00000100:00100000:3.0:1790895490.106458:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1790895490.106469:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33f9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758862208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790895490.106502:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1790895490.106543:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6abee57f, atime: 0x6abee580, ctime: 0x6abee57f, blocks: 0xb 00010000:00010000:3.0:1790895490.106552:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.106582:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1790895490.106587:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895490.106594:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.106610:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.106630:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.106638:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.106658:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1790895490.107583:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33f9a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758862208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1112us (1260us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1790895490.107592:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00010000:3.0:1790895490.107642:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895490.107650:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.107659:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895490.107664:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.107686:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.107708:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.107715:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081d82b00/0x7911a98710cf928e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.107736:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895490.107738:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895490.107740:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790895490.107780:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf310111c00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1790895490.107787:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758862208:0@lo:6:osp-syn-1-0.0 00000020:00080000:0.0:1790895490.108333:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000040:00080000:2.0:1790895490.715522:0:12460:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895490.715530:0:12460:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895490.715566:0:12460:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:2.0:1790895490.715569:0:12460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1790895490.787741:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790895490.840145:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790895490.840153:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790895490.840205:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1790895490.840212:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790895490.840340:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf338c23b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758862336:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790895490.840445:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf301254900 going to sleep for 11 seconds 00000100:00100000:3.0:1790895490.845437:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf338c23b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758862336:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790895490.847673:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895490.849598:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741039744 00000100:00100000:3.0:1790895490.849621:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741039744 00000100:00100000:3.0:1790895490.849710:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 170 00000100:00100000:3.0:1790895490.849721:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11513:x1877889741039744:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790895490.849761:0:7639:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790895490.850566:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11513:x1877889741039744:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 843us (2901us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895490.850576:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 170 00000100:00100000:0.0:1790895490.858008:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895490.859129:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741039872 00000100:00100000:3.0:1790895490.859144:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741039872 00000100:00100000:3.0:1790895490.859206:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 171 00000100:00100000:3.0:1790895490.859217:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11513:x1877889741039872:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1790895490.859311:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859331:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859344:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859360:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859368:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859375:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859404:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859413:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859429:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895490.859474:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1790895490.859479:0:5831:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895490.859494:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859505:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859511:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859519:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859525:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895490.859530:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859538:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859550:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:3.0:1790895490.859553:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895490.859559:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859566:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9295 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859595:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859601:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859619:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859624:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895490.859627:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859633:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859641:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895490.859644:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895490.859647:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859653:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf929c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859667:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859675:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859681:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859692:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895490.859696:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859702:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859710:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310cb5a00) 00010000:00010000:3.0:1790895490.859713:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895490.859716:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.859721:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895490.859800:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11513:x1877889741039872:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 Request processed in 583us (1812us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895490.859808:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 171 00000100:00100000:3.0:1790895490.863986:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895490.864131:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741040128 00000100:00100000:0.0:1790895490.864141:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741040128 00000100:00100000:0.0:1790895490.864205:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 172 00000100:00100000:0.0:1790895490.864216:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+17:11513:x1877889741040128:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895490.864239:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895490.864260:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf92aa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f53 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864375:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864396:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864412:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895490.864424:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790895490.864648:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864669:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864675:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864681:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895490.864685:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864692:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864705:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310cb5a00) 00010000:00010000:0.0:1790895490.864709:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895490.864714:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864720:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864763:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf92aa lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f53 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864773:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:0.0:1790895490.864775:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895490.864778:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf92aa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f53 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.864787:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895490.864893:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741040128:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 678us (917us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1790895490.864900:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 172 00000100:00100000:0.0:1790895490.871904:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895490.872121:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741040256 00000100:00100000:3.0:1790895490.872132:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741040256 00000100:00100000:3.0:1790895490.872184:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 173 00000100:00100000:3.0:1790895490.872192:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741040256:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1790895490.872221:0:7639:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1790895490.872333:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741040256:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 140us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895490.872341:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 173 00000100:00100000:0.0:1790895490.881889:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895490.882703:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741040512 00000100:00100000:3.0:1790895490.882736:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741040512 00000100:00100000:3.0:1790895490.882812:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 174 00000100:00100000:3.0:1790895490.882825:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741040512:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895490.882968:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895490.882971:0:12417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1790895490.883215:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f45 expref: 18 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.883241:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895490.883246:0:12417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895490.883261:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f5a expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790895490.886052:0:12417:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1790895490.887742:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf92c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.887767:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf92c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.887780:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf92c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.887891:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f5a expref: 20 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.887911:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf92c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f5a expref: 19 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.887935:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895490.887938:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790895490.887942:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ce00, rc 0) 00000100:00100000:3.0:1790895490.888037:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11513:x1877889741040512:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 5215us (6191us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1790895490.888047:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 174 00000100:00100000:3.0:1790895490.915205:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895490.915245:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741040768 00000100:00100000:3.0:1790895490.915256:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741040768 00000100:00100000:3.0:1790895490.915307:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 175 00000100:00100000:3.0:1790895490.915318:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11513:x1877889741040768:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790895490.915375:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895490.915405:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf92c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f5a expref: 19 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915427:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895490.915451:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895490.915486:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915503:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915514:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915528:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915546:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915552:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915960:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915969:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915975:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915981:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895490.915985:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.915992:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916001:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895490.916004:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895490.916009:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916014:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf92d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916024:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916036:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916042:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916047:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895490.916050:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916057:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916065:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xfe18851b (ffff8cf3183e2a00) 00010000:00010000:3.0:1790895490.916068:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895490.916070:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.916076:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf92db lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xfe18851b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895490.916160:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf338c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741040768:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 843us (963us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790895490.916168:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 175 00000100:00100000:3.0:1790895490.920423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895490.920663:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741040896 00000100:00100000:0.0:1790895490.920676:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741040896 00000100:00100000:0.0:1790895490.920754:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 176 00000100:00100000:0.0:1790895490.920766:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741040896:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895490.920788:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895490.920814:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f61 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.920852:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.920894:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.920907:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.921040:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf92e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 20 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.921058:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895490.921067:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:0.0:1790895490.921076:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895490.921079:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c200, rc 0) 00000100:00100000:0.0:1790895490.921154:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11513:x1877889741040896:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 390us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895490.921161:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 176 00000100:00100000:3.0:1790895490.937994:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895490.938209:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741041152 00000100:00100000:1.0:1790895490.938221:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741041152 00000100:00100000:1.0:1790895490.938316:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 177 00000100:00100000:1.0:1790895490.938327:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11513:x1877889741041152:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790895490.938418:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.938453:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.938476:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790895490.938773:0:12417:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1790895490.938784:0:12417:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 363905924748ns, next at 364905922245ns, rc = 0 00000004:00010000:1.0:1790895490.938904:0:12417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009a201f16 reply state 00000000cc94cf39 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895490.938914:0:12417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895490.939005:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11513:x1877889741041152:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 680us (1021us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1790895490.939014:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 177 00010000:00010000:1.0:1790895490.941943:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.941977:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.941986:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.941992:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895490.941996:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.942004:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.942021:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:1.0:1790895490.942024:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790895490.942030:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.942037:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf92f0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895490.945513:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895490.947379:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741041280 00000100:00100000:1.0:1790895490.947394:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741041280 00000100:00100000:2.0:1790895490.947627:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 178 00000100:00100000:2.0:1790895490.947639:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+20:11513:x1877889741041280:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895490.947666:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895490.947687:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f68 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895490.947752:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 21 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895490.947768:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 21 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895490.947790:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:2.0:1790895490.947793:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790895490.947797:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e400, rc 0) 00000100:00100000:2.0:1790895490.948541:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11513:x1877889741041280:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 902us (3041us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895490.948549:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 178 00000100:00100000:3.0:1790895490.952230:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895490.952342:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741041408 00000100:00100000:0.0:1790895490.952352:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741041408 00000100:00100000:0.0:1790895490.952460:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:0.0:1790895490.952479:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889741041408:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1790895490.952840:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741041408:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 362us (611us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1790895490.952849:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00080000:2.0:1790895490.953616:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895490.962254:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895490.962317:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741041664 00000100:00100000:2.0:1790895490.962328:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741041664 00000100:00100000:2.0:1790895490.962403:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:2.0:1790895490.962413:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11513:x1877889741041664:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790895490.963365:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+22:11513:x1877889741041664:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 949us (1114us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1790895490.963375:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:1.0:1790895490.965564:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895490.965638:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741041920 00000100:00100000:0.0:1790895490.965650:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741041920 00000100:00100000:0.0:1790895490.965706:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 179 00000100:00100000:0.0:1790895490.965724:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+22:11513:x1877889741041920:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790895490.965955:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+22:11513:x1877889741041920:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 241us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895490.965962:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 179 00000100:00100000:3.0:1790895490.983437:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895490.983726:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741042048 00000100:00100000:1.0:1790895490.983737:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741042048 00000100:00100000:1.0:1790895490.983892:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 180 00000100:00100000:1.0:1790895490.983914:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+22:11513:x1877889741042048:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895490.983936:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895490.983965:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf92fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f6f expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.984053:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9305 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.984072:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.984086:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895490.984129:0:12417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895490.984155:0:12417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9305 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.984188:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf92fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f6f expref: 24 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.984211:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9305 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f6f expref: 23 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895490.984221:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:1.0:1790895490.984225:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790895490.984230:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91da00, rc 0) 00000100:00100000:1.0:1790895490.984310:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+23:11513:x1877889741042048:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 398us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895490.984317:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 180 00000100:00100000:1.0:1790895490.997553:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895490.997639:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741042176 00000100:00100000:3.0:1790895490.997650:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741042176 00000100:00100000:3.0:1790895490.997706:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:3.0:1790895490.997715:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741042176:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895490.997736:0:6690:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895490.997757:0:6690:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f76 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895490.997789:0:6690:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abee583, blocks: 0x1 00010000:00010000:3.0:1790895490.997811:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:3.0:1790895490.997817:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895490.997828:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.997847:0:6690:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 8 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895490.997972:0:6690:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167de00, rc 0) 00000100:00100000:3.0:1790895490.998071:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741042176:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 358us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895490.998077:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:3.0:1790895491.003827:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895491.004019:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741042432 00000100:00100000:0.0:1790895491.004030:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741042432 00000100:00100000:0.0:1790895491.004389:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 181 00000100:00100000:0.0:1790895491.004398:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+23:11513:x1877889741042432:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1790895491.004523:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+23:11513:x1877889741042432:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 126us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895491.004556:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 181 00000100:00080000:2.0:1790895491.004758:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895491.009279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895491.009472:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741042560 00000100:00100000:3.0:1790895491.009487:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741042560 00000100:00100000:3.0:1790895491.009559:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:3.0:1790895491.009571:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+8:11513:x1877889741042560:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895491.009624:0:8701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895491.009648:0:8701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f7d expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.009690:0:8701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.009699:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895491.009703:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895491.009708:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 9 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.009740:0:8701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 9 pid: 6690 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.009762:0:8701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 9 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895491.009772:0:8701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3368bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758862464:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895491.010026:0:8701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf301254900 going to sleep for 11 seconds 00000100:00100000:3.0:1790895491.013478:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895491.014161:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741042688 00000100:00100000:1.0:1790895491.014261:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741042688 00010000:00010000:1.0:1790895491.014540:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 10 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895491.014597:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:1.0:1790895491.014624:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2362:x1877889741042688:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895491.014643:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895491.014670:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 10 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.014701:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 10 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.014729:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895491.014734:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895491.014796:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 10 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.014809:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 10 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.015138:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 10 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895491.015159:0:5818:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1877889758862592:192.168.201.54@tcp:105: 00000100:00100000:1.0:1790895491.015706:0:5818:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da9c0 going to sleep for 11 seconds 00010000:00010000:0.0:1790895491.015922:0:8701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008859f19e/0x7911a98710cf930c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f76 expref: 10 pid: 6690 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.015946:0:8701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3368bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758862464:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895491.015978:0:8701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 9 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.015990:0:8701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:0.0:1790895491.016024:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+9:11513:x1877889741042560:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 6456us (6754us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895491.016032:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:1.0:1790895491.020678:0:5818:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5818:1877889758862592:192.168.201.54@tcp:105: 00010000:00010000:1.0:1790895491.020712:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895491.020795:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741042688:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 6188us (7336us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895491.020808:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:3.0:1790895491.023139:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895491.023227:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741042816 00000100:00100000:0.0:1790895491.023241:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741042816 00002000:00100000:0.0:1790895491.023310:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cf3031f5180 x1877889741042816/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:17/0 lens 504/0 e 0 to 0 dl 1790895502 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895491.023324:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3031f5180 with x1877889741042816 ext(0->8) 00002000:00010000:0.0:1790895491.023331:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf3031f5180 00000100:00100000:0.0:1790895491.023376:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:0.0:1790895491.023387:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741042816:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1790895491.027153:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2362:x1877889741042816:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 Request processed in 3756us (4012us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1790895491.027175:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00002000:00100000:1.0:1790895491.027188:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8cf3031f5180 x1877889741042816/t4294967314(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:17/0 lens 504/448 e 0 to 0 dl 1790895502 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790895491.027691:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3031f5180 with x1877889741042816 ext(0->8) 00002000:00010000:1.0:1790895491.027768:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf3031f5180 00000100:00100000:3.0:1790895491.033447:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895491.033779:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741042944 00000100:00100000:1.0:1790895491.033791:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741042944 00000100:00100000:1.0:1790895491.033911:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 182 00000100:00100000:1.0:1790895491.033925:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+23:11513:x1877889741042944:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1790895491.090101:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000020:00080000:2.0:1790895491.090119:0:5854:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:2.0:1790895491.090130:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:0.0:1790895491.090132:0:12427:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1790895491.090135:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:0.0:1790895491.090150:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1790895491.090159:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790895491.090299:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11513:x1877889741042944:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 Request processed in 56372us (56857us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895491.090310:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 182 00000100:00100000:0.0:1790895491.090754:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758862720:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790895491.090808:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895491.091050:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758862720 00000100:00100000:1.0:1790895491.091058:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758862720 00000100:00080000:2.0:1790895491.091102:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895491.091194:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1790895491.091203:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758862720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790895491.091329:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1790895491.091332:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790895491 00002000:00010000:1.0:1790895491.091334:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790895491.091335:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790895491 -> 1790895491 00002000:00010000:1.0:1790895491.091337:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790895491.091372:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758862720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 171us (565us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1790895491.091385:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1790895491.091447:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf3060c0380/2, rc 0, transno 4294967315 00000100:00100000:0.0:1790895491.091453:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758862720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1790895491.099272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895491.099382:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741043072 00000100:00100000:1.0:1790895491.099393:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741043072 00000100:00100000:1.0:1790895491.099460:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00100000:1.0:1790895491.099472:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2364:x1877889741043072:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1790895491.145655:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000001:00080000:2.0:1790895491.146103:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:3.0:1790895491.149585:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2364:x1877889741043072:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 Request processed in 50105us (50312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895491.149626:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00100000:2.0:1790895491.155212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895491.155523:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741043328 00000100:00100000:1.0:1790895491.155534:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741043328 00000100:00100000:1.0:1790895491.155614:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 183 00000100:00100000:1.0:1790895491.155625:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11513:x1877889741043328:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790895491.155698:0:12417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895491.155727:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9305 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f6f expref: 19 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.155753:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:1.0:1790895491.155759:0:12417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895491.155792:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.155806:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.155814:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895491.156252:0:12417:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000df710be2 reply state 000000009c2490e8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895491.156261:0:12417:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895491.156451:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336f15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+20:11513:x1877889741043328:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 827us (1251us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1790895491.156459:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 183 00010000:00010000:3.0:1790895491.158374:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.158387:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.158392:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.158402:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895491.158408:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.158416:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.158432:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:3.0:1790895491.158436:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895491.158440:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.158446:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf931a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895491.160111:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895491.160200:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741043456 00000100:00100000:3.0:1790895491.160210:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741043456 00000100:00100000:3.0:1790895491.160275:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:3.0:1790895491.160286:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741043456:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1790895491.160532:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1790895491.160548:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790895491 -> 1790895489 00002000:00010000:3.0:1790895491.160550:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790895488 00002000:00010000:3.0:1790895491.160552:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790895491 -> 1790895489 00002000:00010000:3.0:1790895491.160554:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1790895491.160631:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33a815880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741043456:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 348us (533us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1790895491.160638:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:2.0:1790895491.168615:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895491.168939:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741043712 00000100:00100000:0.0:1790895491.168951:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741043712 00000100:00100000:0.0:1790895491.169014:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 184 00000100:00100000:0.0:1790895491.169026:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11513:x1877889741043712:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1790895491.169110:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.169126:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.169133:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.169164:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.169189:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 19 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.169203:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758862848:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895491.169319:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895491.173835:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895491.173970:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741043840 00000100:00100000:3.0:1790895491.174094:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741043840 00010000:00010000:3.0:1790895491.174150:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 20 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.174276:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758862848:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895491.174304:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895491.174424:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:3.0:1790895491.174436:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306504c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+20:2361:x1877889741043840:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895491.174457:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895491.174465:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 20 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.174498:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 20 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.174522:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf92e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f61 expref: 20 pid: 5831 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.174541:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:3.0:1790895491.174546:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.174638:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.174647:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.174678:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895491.174705:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.174713:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895491.174745:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306504c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+19:2361:x1877889741043840:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 311us (920us total) trans 0 rc 0/0 00010000:00010000:0.0:1790895491.174745:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895491.174752:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 69 00010000:00010000:0.0:1790895491.174753:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.174760:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.174766:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895491.174771:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.174779:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.174788:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:0.0:1790895491.174791:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1790895491.174795:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.174814:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9321 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.174906:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741043712:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 Request processed in 5883us (6317us total) trans 0 rc -22/-22 00000100:00100000:0.0:1790895491.174915:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 184 00000100:00100000:2.0:1790895491.180566:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895491.181187:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741043968 00000100:00100000:0.0:1790895491.181201:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741043968 00000100:00100000:1.0:1790895491.181377:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:1.0:1790895491.181391:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741043968:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1790895491.181450:0:8701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.181473:0:8701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 8 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.181483:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1790895491.181488:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790895491.181493:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.181529:0:8701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 8 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.181555:0:8701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 8 pid: 8701 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895491.181571:0:8701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758862976:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895491.181671:0:8701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895491.185329:0:8701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758862976:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895491.185363:0:8701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895491.189836:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895491.189978:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741044096 00000100:00100000:0.0:1790895491.189989:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741044096 00010000:00010000:0.0:1790895491.190033:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 9 pid: 8701 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.190066:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 70 00000100:00100000:0.0:1790895491.190075:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2361:x1877889741044096:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895491.190090:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895491.190113:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 9 pid: 8701 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.190140:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 9 pid: 8701 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.190165:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf9313 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f7d expref: 9 pid: 8701 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.190183:0:11170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895491.190204:0:11170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895491.190210:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.190219:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.190250:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895491.190313:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741044096:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 238us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895491.190320:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 70 00010000:00010000:3.0:1790895491.191691:0:8701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191709:0:8701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191744:0:8701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191753:0:8701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191781:0:8701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191788:0:8701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895491.191792:0:8701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191802:0:8701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191819:0:8701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.191827:0:8701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033ee004e/0x7911a98710cf9328 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895491.191930:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340684e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741043968:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 Request processed in 10539us (11371us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895491.191939:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:2.0:1790895491.219212:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895491.219425:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741044352 00000100:00100000:0.0:1790895491.219437:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741044352 00000100:00100000:0.0:1790895491.219597:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 185 00000100:00100000:0.0:1790895491.219618:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+18:11513:x1877889741044352:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790895491.219727:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.219748:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.219762:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.220302:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.220316:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 19 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.220344:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.220378:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 19 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.220407:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 19 pid: 7639 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.220424:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758863104:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895491.220833:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895491.231761:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895491.232131:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741044480 00000100:00100000:3.0:1790895491.232144:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741044480 00010000:00010000:3.0:1790895491.232186:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 20 pid: 7639 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895491.232232:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 71 00000100:00100000:3.0:1790895491.232258:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:2362:x1877889741044480:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895491.232273:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895491.232280:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 20 pid: 7639 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.232307:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 20 pid: 7639 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.232331:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:3.0:1790895491.232337:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.232346:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.232354:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895491.232374:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895491.232439:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:2362:x1877889741044480:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 182us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895491.232445:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 71 00010000:00010000:0.0:1790895491.235152:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e400/0x7911a98710cf92f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f68 expref: 19 pid: 7639 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.235177:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758863104:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895491.235201:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.235211:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.235217:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895491.235625:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1790895491.236210:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1790895491.236266:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1790895491.236509:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1877889758863232:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790895491.236581:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895491.236628:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895491.237540:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758863232 00000100:00100000:2.0:1790895491.237551:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758863232 00000100:00100000:2.0:1790895491.237628:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790895491.237639:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1877889758863232:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1790895491.237765:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5832:x1877889758863232:12345-0@lo:1000:mdt00_001.0 Request processed in 128us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895491.237772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790895491.237905:0:5832:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:0.0:1790895491.237911:0:5832:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf3060c0380, transno 4294967315 00000100:00100000:0.0:1790895491.237927:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1877889758863232:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1790895491.238413:0:5832:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1790895491.238481:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1877889758863360:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1790895491.238517:0:5832:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895491.238536:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895491.238824:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758863360 00000100:00100000:3.0:1790895491.238830:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758863360 00000100:00100000:3.0:1790895491.238892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790895491.238901:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5832:x1877889758863360:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1790895491.239070:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5832:x1877889758863360:12345-0@lo:1000:mdt00_001.0 Request processed in 170us (551us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1790895491.239096:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1790895491.239559:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5832:1877889758863360:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1790895491.239591:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239613:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239620:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239626:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895491.239630:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239637:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239652:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf31037c400) 00010000:00010000:0.0:1790895491.239655:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895491.239666:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239672:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9336 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239715:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239721:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239727:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239732:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895491.239735:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239740:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239748:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310cb5a00) 00010000:00010000:0.0:1790895491.239751:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895491.239754:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239759:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf926b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239779:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239793:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239807:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.239834:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.240726:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 22 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.240743:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758863488:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895491.250662:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895491.259710:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895491.259904:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741044608 00000100:00100000:0.0:1790895491.259914:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741044608 00010000:00010000:0.0:1790895491.259959:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 23 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895491.260014:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 72 00000100:00100000:0.0:1790895491.260025:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+23:2361:x1877889741044608:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895491.260039:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895491.260046:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 23 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.260078:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 23 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.260114:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310cb5a00) 00010000:00010000:0.0:1790895491.260121:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.260148:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.260155:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.260176:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895491.260233:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+23:2361:x1877889741044608:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 209us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895491.260240:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 72 00010000:00010000:1.0:1790895491.260589:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9287 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f4c expref: 22 pid: 5833 timeout: 464 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895491.260627:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758863488:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895491.260653:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260661:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260666:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260689:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260703:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260710:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260716:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895491.260720:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260728:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260738:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310cb5a00) 00010000:00010000:1.0:1790895491.260740:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895491.260745:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260759:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf933d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260773:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260778:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260783:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260789:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895491.260791:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260798:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260806:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf310cb5a00) 00010000:00010000:1.0:1790895491.260808:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1790895491.260811:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895491.260816:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf932f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895491.261223:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11513:x1877889741044352:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 41607us (42019us total) trans 4294967466 rc 0/0 00000100:00100000:1.0:1790895491.261232:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 185 00000020:00080000:1.0:1790895491.261243:0:5832:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790895491.261492:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790895491.261497:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790895491.262031:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1790895491.262042:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790895491.271813:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895491.272240:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741044864 00000100:00100000:2.0:1790895491.272252:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741044864 00000100:00100000:2.0:1790895491.272310:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:2.0:1790895491.272319:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11513:x1877889741044864:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790895491.273383:0:5835:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790895491.274007:0:5835:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1790895491.274070:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895491.274152:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895491.274168:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895491.274177:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895491.274184:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895491.274190:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895491.274207:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790895491.274323:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+23:11513:x1877889741044864:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 2001us (2517us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1790895491.274332:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 50 00000020:00080000:2.0:1790895491.274338:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790895491.274664:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895491.274672:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.274680:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895491.274683:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.274692:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.274706:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8cf310c7ec00) 00010000:00010000:0.0:1790895491.274709:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1790895491.274714:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.274720:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9344 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895491.274737:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895491.274747:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895491.274749:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895491.800912:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790895492.623238:0:12513:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790895492.623247:0:12513:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790895492.623289:0:12513:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1790895492.623294:0:12513:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1790895492.814984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895492.815301:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741045120 00000100:00100000:1.0:1790895492.815313:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741045120 00000100:00100000:1.0:1790895492.815375:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 186 00000100:00100000:1.0:1790895492.815386:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+23:11530:x1877889741045120:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895492.815410:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895492.815430:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf934b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f84 expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895492.815534:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9352 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895492.815549:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895492.815562:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9352 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895492.815573:0:12417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1790895492.815702:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf934b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f84 expref: 26 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895492.815721:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9352 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f84 expref: 25 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895492.815729:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895492.815740:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790895492.815744:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c600, rc 0) 00000100:00100000:1.0:1790895492.815853:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+25:11530:x1877889741045120:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 468us (876us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1790895492.815883:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 186 00010000:00010000:1.0:1790895492.824374:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895492.834060:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895492.838081:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741045248 00000100:00100000:0.0:1790895492.838099:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741045248 00000100:00100000:0.0:1790895492.838177:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 187 00000100:00100000:0.0:1790895492.838187:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+25:11530:x1877889741045248:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:0.0:1790895492.838266:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838283:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838295:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838310:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838318:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838324:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838589:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838598:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838606:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895492.838656:0:5831:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838669:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838677:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838685:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838691:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895492.838695:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838702:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838714:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895492.838717:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895492.838722:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838728:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9360 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838740:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838745:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838757:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838762:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895492.838765:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838771:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838779:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf31037c100) 00010000:00010000:0.0:1790895492.838781:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895492.838784:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838790:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf9367 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838804:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.838810:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.839266:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.839271:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895492.839274:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.839288:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.839296:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895492.839299:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895492.839302:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.839307:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf936e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895492.839404:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+25:11530:x1877889741045248:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 1208us (5345us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895492.839413:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 187 00000100:00100000:0.0:1790895492.896112:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895492.896150:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741045504 00000100:00100000:0.0:1790895492.896170:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741045504 00000100:00100000:0.0:1790895492.896225:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 188 00000100:00100000:0.0:1790895492.896236:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+25:11533:x1877889741045504:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895492.896259:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895492.896281:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9375 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f8b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.896355:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.896370:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.896403:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.896419:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.896427:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.896434:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.900657:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.900677:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.900689:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895492.900703:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1790895492.904360:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904387:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904396:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904402:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895492.904424:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904435:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904452:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895492.904455:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895492.904461:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904468:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf937c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904484:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904491:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904496:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904502:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895492.904505:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904511:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904519:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895492.904521:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895492.904531:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904537:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9383 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904610:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9375 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904625:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.904633:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895492.904635:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895492.904638:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7de00, rc 0) 00000100:00100000:0.0:1790895492.904714:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+27:11533:x1877889741045504:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 8480us (8610us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1790895492.904724:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 188 00000100:00100000:3.0:1790895492.909115:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895492.913686:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741045632 00000100:00100000:0.0:1790895492.913707:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741045632 00000100:00100000:0.0:1790895492.913788:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 189 00000100:00100000:0.0:1790895492.913800:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+27:11533:x1877889741045632:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:0.0:1790895492.913892:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.913911:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.913923:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.913972:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.913979:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.913987:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.913993:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895492.913998:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.914005:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.914017:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895492.914020:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895492.914025:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895492.914031:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9398 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895492.914111:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+27:11533:x1877889741045632:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 312us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895492.914118:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 189 00000100:00100000:3.0:1790895492.917581:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895492.917652:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741045888 00000100:00100000:1.0:1790895492.917662:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741045888 00000100:00100000:1.0:1790895492.917720:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:1.0:1790895492.917730:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+27:11533:x1877889741045888:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895492.917995:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+28:11533:x1877889741045888:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 265us (432us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1790895492.918003:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:0.0:1790895492.976208:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895492.977547:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741046144 00000100:00100000:3.0:1790895492.977560:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741046144 00000100:00100000:3.0:1790895492.977679:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 190 00000100:00100000:3.0:1790895492.977690:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+28:11059:x1877889741046144:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895492.977717:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895492.977739:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf939f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f92 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.977841:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.977916:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.977928:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.978039:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 29 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.978067:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 29 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895492.978081:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf33929dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758863616:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895492.978211:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3064999c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895492.998479:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895492.998714:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741046272 00000100:00100000:2.0:1790895492.998738:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741046272 00010000:00010000:2.0:1790895492.998779:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 30 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895492.998825:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00100000:2.0:1790895492.998835:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+30:2362:x1877889741046272:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895492.998851:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895492.998887:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 30 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895492.998913:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 30 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895492.998935:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:2.0:1790895492.998941:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895492.998950:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895492.998958:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895492.998977:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895492.999028:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+30:2362:x1877889741046272:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 193us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895492.999034:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 73 00010000:00010000:3.0:1790895492.999125:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf938a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f8b expref: 29 pid: 5832 timeout: 465 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895492.999140:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf33929dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5831:1877889758863616:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895492.999169:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.999178:0:5831:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.999183:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895492.999200:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1790895492.999337:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf939f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 30 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.999353:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 29 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895492.999376:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:3.0:1790895492.999378:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790895492.999381:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ce00, rc 0) 00000100:00100000:3.0:1790895492.999405:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+29:11059:x1877889741046144:12345-192.168.201.54@tcp:101:bash.0 Request processed in 21717us (23205us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1790895492.999412:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 190 00000100:00100000:3.0:1790895493.001756:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895493.001794:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.002032:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741046784 00000100:00100000:0.0:1790895493.002041:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741046784 00000100:00100000:0.0:1790895493.002115:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 146 00000100:00100000:0.0:1790895493.002125:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889741046784:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895493.002379:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895493.002457:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741046528 00000100:00100000:2.0:1790895493.002462:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741046528 00000100:00100000:2.0:1790895493.002499:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00100000:2.0:1790895493.002508:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741046528:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895493.002560:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741046528:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 54us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895493.002567:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00080000:2.0:1790895493.002595:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790895493.002599:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895493.002841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895493.002890:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895493.002907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741047040 00000100:00100000:3.0:1790895493.002911:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741047040 00000100:00100000:3.0:1790895493.002943:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 191 00000100:00100000:3.0:1790895493.002950:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+29:11059:x1877889741047040:12345-192.168.201.54@tcp:36:bash.0 00010000:00010000:3.0:1790895493.003251:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.003266:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.003278:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1790895493.003329:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1790895493.003355:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000066853342 reply state 00000000e3ba41ff transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895493.003377:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1790895493.003442:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1790895493.003515:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+33:11059:x1877889741047040:12345-192.168.201.54@tcp:36:bash.0 Request processed in 564us (624us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1790895493.003522:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 191 00000020:00080000:3.0:1790895493.003526:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1790895493.003675:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2361:x1877889741046784:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 1551us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.003683:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 146 00000100:00100000:2.0:1790895493.004064:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741046656 00000100:00100000:2.0:1790895493.004069:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741046656 00000100:00100000:2.0:1790895493.004109:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 74 00000100:00100000:2.0:1790895493.004119:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf33929df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889741046656:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895493.004165:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf33929df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889741046656:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 39us (1314us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895493.004172:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 74 00000100:00080000:2.0:1790895493.004188:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895493.004192:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895493.008231:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008249:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008257:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008264:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895493.008269:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008277:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008294:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895493.008297:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895493.008303:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008308:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf93b4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895493.008505:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.008567:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741047168 00000100:00100000:0.0:1790895493.008585:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741047168 00000100:00100000:0.0:1790895493.008652:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 192 00000100:00100000:0.0:1790895493.008661:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+32:11059:x1877889741047168:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895493.008684:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895493.008699:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf93bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2f99 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008756:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf93bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f99 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008769:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf93bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f99 expref: 33 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.008785:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895493.008788:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895493.008790:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c200, rc 0) 00000100:00100000:0.0:1790895493.008841:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+33:11059:x1877889741047168:12345-192.168.201.54@tcp:101:bash.0 Request processed in 181us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.008848:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 192 00000100:00100000:1.0:1790895493.010347:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741046400 00000100:00100000:1.0:1790895493.010357:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741046400 00000100:00100000:1.0:1790895493.010404:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 292 00000100:00100000:1.0:1790895493.010413:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741046400:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895493.010476:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741046400:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 63us (8097us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895493.010483:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 292 00000100:00100000:3.0:1790895493.011283:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895493.011404:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741047296 00000100:00100000:2.0:1790895493.011410:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741047296 00000100:00100000:2.0:1790895493.011460:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 58 00000100:00100000:2.0:1790895493.011470:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:11059:x1877889741047296:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895493.011483:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895493.011501:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fa0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895493.011527:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abee581, atime: 0x6abee580, ctime: 0x6abee581, blocks: 0xb 00010000:00010000:2.0:1790895493.011544:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1790895493.011554:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895493.011563:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.011586:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.011598:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f600, rc 0) 00000100:00100000:2.0:1790895493.011634:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:11059:x1877889741047296:12345-192.168.201.54@tcp:101:bash.0 Request processed in 167us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895493.011640:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 58 00000100:00100000:2.0:1790895493.013620:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.013692:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741047424 00000100:00100000:0.0:1790895493.013701:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741047424 00002000:00010000:0.0:1790895493.013732:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1790895493.013737:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf336be6d80 with x1877889741047424 ext(0->18446744073709551615) 00002000:00010000:0.0:1790895493.013746:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf336be6d80. 00000100:00100000:0.0:1790895493.013773:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1790895493.013782:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2363:x1877889741047424:12345-192.168.201.54@tcp:10:bash.0 00002000:00010000:0.0:1790895493.014065:0:6694:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1790895493.014069:0:6694:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1790895489 -> 1790895493 00002000:00010000:0.0:1790895493.014082:0:6694:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1790895488 -> 1790895488 00002000:00010000:0.0:1790895493.014084:0:6694:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1790895489 -> 1790895493 00002000:00010000:0.0:1790895493.014087:0:6694:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1790895493.014137:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2363:x1877889741047424:12345-192.168.201.54@tcp:10:bash.0 Request processed in 356us (522us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1790895493.014145:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00002000:00010000:0.0:1790895493.014148:0:6694:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1790895493.014151:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf336be6d80 with x1877889741047424 ext(0->18446744073709551615) 00002000:00010000:0.0:1790895493.014252:0:6694:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf336be6d80. 00000100:00100000:0.0:1790895493.117892:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895493.127028:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741047552 00000100:00100000:1.0:1790895493.127044:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741047552 00000100:00100000:1.0:1790895493.127110:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 193 00000100:00100000:1.0:1790895493.127121:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+33:11548:x1877889741047552:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:1.0:1790895493.127206:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127236:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127250:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127265:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127271:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127278:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127517:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127527:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127534:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895493.127584:0:12417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127595:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127601:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127617:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.127623:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895493.127627:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130418:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130440:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895493.130443:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895493.130449:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130456:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf93c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130478:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130486:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130493:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130499:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895493.130502:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130527:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130536:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310cb5a00) 00010000:00010000:1.0:1790895493.130538:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895493.130541:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130547:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf93d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130566:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130583:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130588:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130593:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895493.130595:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130601:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130608:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:1.0:1790895493.130610:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895493.130613:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.130626:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf93d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895493.130909:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+33:11548:x1877889741047552:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 3785us (13051us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895493.130921:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 193 00000100:00100000:1.0:1790895493.194777:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.194964:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741047808 00000100:00100000:0.0:1790895493.194975:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741047808 00000100:00100000:0.0:1790895493.195042:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 194 00000100:00100000:0.0:1790895493.195054:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+33:11551:x1877889741047808:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895493.195085:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895493.195110:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf93de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fa7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195381:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195396:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195408:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195423:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195445:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195453:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195744:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf93f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195755:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf93f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195762:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf93f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895493.195773:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1790895493.195916:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195924:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195931:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195937:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895493.195941:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195960:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195983:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895493.195986:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895493.195992:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.195999:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf93e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196012:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196019:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196025:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196030:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895493.196033:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196040:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196047:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895493.196049:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895493.196052:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196527:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf93ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196600:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf93de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa7 expref: 36 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196617:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf93f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa7 expref: 35 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.196624:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895493.197967:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1790895493.197987:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d400, rc 0) 00000100:00100000:0.0:1790895493.200313:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11551:x1877889741047808:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 5240us (5530us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1790895493.200331:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 194 00000100:00100000:3.0:1790895493.207709:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.207841:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741047936 00000100:00100000:0.0:1790895493.207852:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741047936 00000100:00100000:0.0:1790895493.207961:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 195 00000100:00100000:0.0:1790895493.207972:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11551:x1877889741047936:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:0.0:1790895493.208046:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.208064:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.208074:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.208107:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 35 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.208152:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 35 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895493.208168:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758863744:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895493.208252:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305962840 going to sleep for 11 seconds 00000100:00100000:3.0:1790895493.214540:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895493.217103:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741048192 00000100:00100000:1.0:1790895493.217126:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741048192 00000100:00100000:1.0:1790895493.217223:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:1.0:1790895493.217235:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+36:5600:x1877889741048192:12345-192.168.201.54@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1790895493.219280:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+37:5600:x1877889741048192:12345-192.168.201.54@tcp:35:ldlm_bl.0 Request processed in 2038us (4739us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1790895493.219292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:0.0:1790895493.220324:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758863744:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895493.220351:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895493.221466:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.221538:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741048320 00000100:00100000:0.0:1790895493.221548:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741048320 00010000:00010000:0.0:1790895493.221592:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 37 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895493.221637:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 74 00000100:00100000:0.0:1790895493.221647:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+37:2361:x1877889741048320:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895493.221662:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895493.221668:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 37 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.221693:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 37 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.221716:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf93a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f92 expref: 37 pid: 5831 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.221752:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895493.221758:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.221766:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.221774:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.221805:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895493.221896:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100eed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+36:2361:x1877889741048320:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 210us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.221904:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 74 00010000:00010000:3.0:1790895493.222201:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222210:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222242:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222250:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222256:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222261:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7cc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895493.222265:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222285:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222294:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:3.0:1790895493.222297:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895493.222301:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.222307:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895493.222346:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11551:x1877889741047936:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 14376us (14648us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895493.222354:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 195 00000100:00100000:2.0:1790895493.224321:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895493.224402:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741048576 00000100:00100000:1.0:1790895493.224410:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741048576 00000100:00100000:1.0:1790895493.224463:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:1.0:1790895493.224473:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+35:11551:x1877889741048576:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:1.0:1790895493.224709:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+36:11551:x1877889741048576:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 237us (393us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1790895493.224717:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 53 00000040:00080000:0.0:1790895493.336638:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790895493.336650:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790895493.336900:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1790895493.336908:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790895493.368563:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895493.368666:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741048832 00000100:00100000:3.0:1790895493.368677:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741048832 00000100:00100000:3.0:1790895493.368747:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 196 00000100:00100000:3.0:1790895493.368757:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+36:11562:x1877889741048832:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:3.0:1790895493.368786:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895493.368821:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9408 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fae expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.368968:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.368983:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.368996:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.369025:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.369033:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.369040:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.369744:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf941d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.369755:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf941d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.369763:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf941d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895493.369772:0:12417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1790895493.370315:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370325:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370332:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370337:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895493.370341:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370360:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370374:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895493.370377:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895493.370382:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370388:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf940f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370404:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370410:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370416:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370421:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895493.370423:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370429:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370436:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf3183e2a00) 00010000:00010000:3.0:1790895493.370438:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895493.370441:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370456:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370503:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9408 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fae expref: 39 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370518:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf941d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fae expref: 38 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.370526:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:3.0:1790895493.370529:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790895493.370531:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ce00, rc 0) 00000100:00100000:3.0:1790895493.370767:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+38:11562:x1877889741048832:12345-192.168.201.54@tcp:101:cat.0 Request processed in 2010us (2214us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1790895493.370776:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 196 00000100:00100000:0.0:1790895493.385306:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895493.385415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741049088 00000100:00100000:1.0:1790895493.385428:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741049088 00000100:00100000:1.0:1790895493.385492:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 54 00000100:00100000:1.0:1790895493.385502:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+38:11562:x1877889741049088:12345-192.168.201.54@tcp:35:cat.0 00000100:00100000:1.0:1790895493.385820:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+39:11562:x1877889741049088:12345-192.168.201.54@tcp:35:cat.0 Request processed in 309us (514us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1790895493.385829:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 54 00000100:00100000:2.0:1790895493.448512:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.449007:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741049344 00000100:00100000:0.0:1790895493.449020:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741049344 00000100:00100000:0.0:1790895493.449097:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 197 00000100:00100000:0.0:1790895493.449108:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+39:11563:x1877889741049344:12345-192.168.201.54@tcp:36:rm.0 00010000:00010000:0.0:1790895493.449330:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1790895493.449361:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf941d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fae expref: 39 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449422:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf93f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa7 expref: 38 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449435:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf93bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f99 expref: 37 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449444:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c100) 00010000:00010000:0.0:1790895493.449463:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895493.449484:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449496:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449506:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449520:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449527:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.449533:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.450405:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.450418:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.450435:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790895493.453354:0:5832:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1790895493.453372:0:5832:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 366420513053ns, next at 367420509815ns, rc = 0 00010000:00010000:0.0:1790895493.453771:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453790:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453810:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453819:0:5832:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453825:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453831:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453894:0:5832:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790895493.453918:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453924:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453930:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453959:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895493.453964:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453972:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.453985:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:0.0:1790895493.453988:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1790895493.453995:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454001:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf9439 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454024:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454030:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454036:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454041:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895493.454044:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454049:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454076:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895493.454078:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895493.454081:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.454087:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c600/0x7911a98710cf942b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1790895493.454097:0:5832:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000993d4917 reply state 00000000464010cd transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895493.454106:0:5832:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790895493.454528:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+38:11563:x1877889741049344:12345-192.168.201.54@tcp:36:rm.0 Request processed in 5417us (6023us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1790895493.454537:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 197 00010000:00010000:1.0:1790895493.454662:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895493.454670:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.454677:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895493.454680:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.454687:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.454707:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8cf31037c500) 00010000:00010000:1.0:1790895493.454710:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1790895493.454713:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.454718:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9440 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.454734:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895493.454736:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895493.454738:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895493.457533:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.457552:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.457560:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.457578:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895493.457582:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.457590:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.457636:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf31037cb00) 00010000:00010000:0.0:1790895493.457640:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895493.457646:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.457653:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9432 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895493.548344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895493.548770:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741049600 00000100:00100000:3.0:1790895493.548782:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741049600 00000100:00100000:3.0:1790895493.548847:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 198 00000100:00100000:3.0:1790895493.548887:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30748ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+37:11569:x1877889741049600:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895493.548912:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895493.548931:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9447 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fb5 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.549068:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.549084:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.549109:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.549125:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.549132:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.549138:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1790895493.549978:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1790895493.550153:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550164:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550173:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550208:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550215:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550221:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550226:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895493.550236:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550243:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550254:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895493.550257:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895493.550262:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550268:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf944e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790895493.550280:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000025eee0c3 reply state 00000000d9f2b1da transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895493.550289:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1790895493.550317:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9447 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550332:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 39 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.550339:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895493.550342:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790895493.550344:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167da00, rc 0) 00000100:00100000:3.0:1790895493.551294:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30748ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+40:11569:x1877889741049600:12345-192.168.201.54@tcp:101:bash.0 Request processed in 2432us (2956us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1790895493.551304:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 198 00010000:00010000:0.0:1790895493.567187:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.567205:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.567212:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.567218:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895493.567222:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.567229:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.567246:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf3183e2a00) 00010000:00010000:0.0:1790895493.567249:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895493.567254:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.567261:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9455 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895493.588092:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.588275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741049728 00000100:00100000:0.0:1790895493.588286:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741049728 00000100:00100000:0.0:1790895493.588350:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:0.0:1790895493.588362:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2364:x1877889741049728:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895493.588385:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895493.588405:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fbc expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1790895493.588439:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1790895493.588470:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=366s v=(0 0) 00010000:00010000:0.0:1790895493.588475:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895493.588484:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.588505:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.588518:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c600, rc 0) 00000100:00100000:0.0:1790895493.588590:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889741049728:12345-192.168.201.54@tcp:101:bash.0 Request processed in 231us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.588597:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:3.0:1790895493.591993:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895493.594043:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741049856 00000100:00100000:2.0:1790895493.594059:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741049856 00000100:00100000:2.0:1790895493.594128:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:2.0:1790895493.594148:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+6:11569:x1877889741049856:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895493.594168:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895493.594187:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fc3 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.594220:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.594248:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895493.594252:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895493.594258:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.594292:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.594320:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 7 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895493.594335:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1877889758863872:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895493.594446:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895493.599128:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.599886:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6688:1877889758863872:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895493.599919:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.599966:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84ea00, rc 0) 00000100:00100000:2.0:1790895493.600137:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741049984 00000100:00100000:2.0:1790895493.600407:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741049984 00010000:00010000:2.0:1790895493.600442:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 8 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895493.600595:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:11569:x1877889741049856:12345-192.168.201.54@tcp:101:bash.0 Request processed in 6456us (8611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.600604:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:2.0:1790895493.600712:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 75 00000100:00100000:2.0:1790895493.600722:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741049984:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895493.600738:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895493.600760:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 7 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.600797:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 7 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.600821:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3d950ae/0x7911a98710cf946a lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fbc expref: 7 pid: 6691 timeout: 466 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.600835:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895493.600839:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895493.600846:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.600887:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.600922:0:5817:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895493.600935:0:5817:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1877889758864000:192.168.201.54@tcp:105: 00000100:00100000:2.0:1790895493.603070:0:5817:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895493.615492:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895493.615546:0:5817:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf30fe6ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5817:1877889758864000:192.168.201.54@tcp:105: 00010000:00010000:2.0:1790895493.615583:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895493.615641:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2362:x1877889741049984:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 14920us (16520us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895493.615668:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 75 00000100:00100000:2.0:1790895493.615723:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741050240 00000100:00100000:2.0:1790895493.615734:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741050240 00000100:00100000:2.0:1790895493.615770:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 55 00000100:00100000:2.0:1790895493.615779:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+39:11569:x1877889741050240:12345-192.168.201.54@tcp:35:bash.0 00000001:00080000:2.0:1790895493.616111:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967483 00000100:00100000:2.0:1790895493.616181:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+41:11569:x1877889741050240:12345-192.168.201.54@tcp:35:bash.0 Request processed in 402us (698us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1790895493.616188:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 55 00000020:00080000:2.0:1790895493.616191:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790895493.847983:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895493.854434:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895493.857340:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741050368 00000100:00100000:1.0:1790895493.857358:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741050368 00000100:00100000:1.0:1790895493.857440:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 199 00000100:00100000:1.0:1790895493.857460:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+41:11585:x1877889741050368:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895493.857486:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895493.857519:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fca expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.857633:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf947f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.857646:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf947f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.857657:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf947f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895493.857692:0:12417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1790895493.857695:0:12417:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895493.857713:0:12417:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf947f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.857737:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fca expref: 43 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.857755:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf947f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fca expref: 42 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.857763:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895493.857766:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790895493.857770:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d800, rc 0) 00000100:00100000:1.0:1790895493.857833:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+42:11585:x1877889741050368:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 384us (3407us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895493.857840:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 199 00000100:00100000:1.0:1790895493.862666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.863550:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741050624 00000100:00100000:0.0:1790895493.863573:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741050624 00000100:00100000:0.0:1790895493.863644:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 200 00000100:00100000:0.0:1790895493.863654:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+42:11585:x1877889741050624:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895493.863681:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895493.863705:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9486 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fd1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.863816:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf948d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.863831:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf948d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.863840:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf948d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895493.863851:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790895493.869147:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9486 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fd1 expref: 45 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.869178:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf948d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fd1 expref: 44 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.869188:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:1.0:1790895493.869191:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895493.869194:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d400, rc 0) 00000100:00100000:1.0:1790895493.869268:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+44:11585:x1877889741050624:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 5614us (6610us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1790895493.869277:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 200 00000100:00100000:2.0:1790895493.877987:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895493.878085:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895493.878133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741051008 00000100:00100000:2.0:1790895493.878143:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741051008 00000100:00100000:2.0:1790895493.878196:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 201 00000100:00100000:2.0:1790895493.878206:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+44:11585:x1877889741051008:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895493.878230:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895493.878251:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf949b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fd8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.878347:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf94a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.878364:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf94a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.878376:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf94a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895493.878404:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1790895493.878518:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf949b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fd8 expref: 47 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.878537:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf94a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fd8 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.878547:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:2.0:1790895493.878549:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1790895493.878554:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f400, rc 0) 00000100:00100000:2.0:1790895493.878629:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+46:11585:x1877889741051008:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 414us (533us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1790895493.878637:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 201 00000001:00080000:2.0:1790895493.889226:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000100:00100000:0.0:1790895493.889342:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741050752 00000100:00100000:0.0:1790895493.889354:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741050752 00000100:00100000:0.0:1790895493.889431:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:0.0:1790895493.889442:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306505850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+46:2361:x1877889741050752:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895493.889456:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895493.889495:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf948d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fd1 expref: 46 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.889516:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:0.0:1790895493.889521:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895493.889590:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306505850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+45:2361:x1877889741050752:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 149us (11614us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.889598:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:2.0:1790895493.905713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.905964:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741051136 00000100:00100000:0.0:1790895493.905975:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741051136 00000100:00100000:0.0:1790895493.906036:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:0.0:1790895493.906046:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+6:2364:x1877889741051136:12345-192.168.201.54@tcp:1:lfs.0 00010000:00010000:0.0:1790895493.906089:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.906109:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.906117:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895493.906121:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895493.906126:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.906168:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.906194:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 6 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895493.906224:0:6691:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758864128:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895493.906320:0:6691:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305962180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895493.913737:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.914121:0:6691:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6691:1877889758864128:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895493.914300:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895493.914378:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741051264 00000100:00100000:1.0:1790895493.914386:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741051264 00002000:00100000:1.0:1790895493.914437:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cf3100ec000 x1877889741051264/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:19/0 lens 504/0 e 0 to 0 dl 1790895504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790895493.914445:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3100ec000 with x1877889741051264 ext(0->8) 00010000:00010000:1.0:1790895493.914453:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 7 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.914481:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 7 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790895493.914489:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf3100ec000 00000100:00100000:1.0:1790895493.914520:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:1.0:1790895493.914529:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741051264:12345-192.168.201.54@tcp:4:lfs.0 00000100:00100000:1.0:1790895493.915347:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2362:x1877889741051264:12345-192.168.201.54@tcp:4:lfs.0 Request processed in 816us (1618us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1790895493.915356:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00002000:00100000:1.0:1790895493.915364:0:6695:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8cf3100ec000 x1877889741051264/t4294967308(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:19/0 lens 504/448 e 0 to 0 dl 1790895504 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1790895493.915373:0:6695:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf3100ec000 with x1877889741051264 ext(0->8) 00010000:00010000:1.0:1790895493.915380:0:6695:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.915398:0:6695:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790895493.915406:0:6695:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8cf3100ec000 00000100:00100000:2.0:1790895493.921634:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.921827:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741051392 00000100:00100000:0.0:1790895493.921839:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741051392 00010000:00010000:0.0:1790895493.921917:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895493.922074:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 76 00000100:00100000:0.0:1790895493.922086:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2363:x1877889741051392:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895493.922103:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1790895493.922126:0:5816:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1790895493.922129:0:5816:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1790895494 00002000:00010000:0.0:1790895493.922131:0:5816:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1790895494 00002000:00010000:0.0:1790895493.922132:0:5816:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1790895494 00010000:00010000:0.0:1790895493.922288:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.922322:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.922372:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ae9784c/0x7911a98710cf9471 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fc3 expref: 9 pid: 6688 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.922390:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895493.922406:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895493.922413:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.922423:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.922459:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895493.922512:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2363:x1877889741051392:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 428us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.922520:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 76 00010000:00010000:2.0:1790895493.922709:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922719:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922744:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922753:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922767:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922776:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895493.922780:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922790:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922811:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895493.922818:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008b32d357/0x7911a98710cf94b0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895493.922900:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fe6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2364:x1877889741051136:12345-192.168.201.54@tcp:1:lfs.0 Request processed in 16855us (17195us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895493.922908:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:2.0:1790895493.933735:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895493.934144:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741051648 00000100:00100000:1.0:1790895493.934154:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741051648 00000100:00100000:1.0:1790895493.934204:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 56 00000100:00100000:1.0:1790895493.934214:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+45:11585:x1877889741051648:12345-192.168.201.54@tcp:35:lfs.0 00000004:00010000:1.0:1790895493.934278:0:5834:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf94a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fd8 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895493.934578:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1790895493.934622:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1790895493.936291:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1790895493.936372:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.936392:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.936413:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.936658:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.936687:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 49 pid: 5833 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895493.936702:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1877889758864256:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895493.937563:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e65900 going to sleep for 11 seconds 00000100:00100000:1.0:1790895493.942777:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5834:1877889758864256:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895493.942817:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895493.949834:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895493.950257:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741051776 00000100:00100000:0.0:1790895493.950268:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741051776 00010000:00010000:0.0:1790895493.950310:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 50 pid: 5833 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895493.950354:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 77 00000100:00100000:0.0:1790895493.950364:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+50:2362:x1877889741051776:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895493.950378:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895493.950386:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 50 pid: 5833 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.950431:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 50 pid: 5833 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.950463:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf945c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fb5 expref: 50 pid: 5833 timeout: 466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.950482:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:0.0:1790895493.950488:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.950498:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.950505:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895493.950525:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895493.950589:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+49:2362:x1877889741051776:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 226us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895493.950597:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 77 00010000:00010000:1.0:1790895493.950918:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.950927:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895493.951071:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1790895493.951432:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1790895493.952385:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1877889758864384:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790895493.952444:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895493.953260:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758864384 00000100:00100000:3.0:1790895493.953270:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758864384 00000100:00100000:3.0:1790895493.953319:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790895493.953326:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1877889758864384:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1790895493.953395:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3370f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1877889758864384:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (951us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895493.953402:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1790895493.953481:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895493.953619:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895493.953642:0:5834:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1790895493.953659:0:5834:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf310111c00, transno 4294967307 00000100:00100000:1.0:1790895493.953679:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1877889758864384:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790895493.954567:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1790895493.954642:0:5834:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1877889758864512:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1790895493.954703:0:5834:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895493.954738:0:5834:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e65900 going to sleep for 11 seconds 00000100:00100000:0.0:1790895493.955297:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758864512 00000100:00100000:0.0:1790895493.955304:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758864512 00000100:00100000:0.0:1790895493.955346:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790895493.955355:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5834:x1877889758864512:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1790895493.955519:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5834:x1877889758864512:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 166us (815us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1790895493.955526:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790895493.956006:0:5834:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3370fb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5834:1877889758864512:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1790895493.956227:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1790895493.956271:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.956281:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.956290:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.956296:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895493.956300:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.956309:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.956327:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:1.0:1790895493.956331:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1790895493.956336:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895493.956343:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790895493.957701:0:5834:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1790895493.957813:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1790895493.957825:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 366924966718ns, next at 367924964438ns, rc = 0 00000001:00080000:1.0:1790895493.957834:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1790895493.957916:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:1.0:1790895493.957920:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1790895493.957929:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf94a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fd8 expref: 53 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895493.958073:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+52:11585:x1877889741051648:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 23859us (24347us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1790895493.958081:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 56 00000020:00080000:1.0:1790895493.958086:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1790895493.961671:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895493.961843:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741051904 00000100:00100000:3.0:1790895493.961855:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741051904 00000100:00100000:3.0:1790895493.966890:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 202 00000100:00100000:3.0:1790895493.966902:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+52:11585:x1877889741051904:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895493.966928:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895493.966960:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf94be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fdf expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.967019:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf94be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fdf expref: 53 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.967032:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf94be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fdf expref: 53 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895493.967316:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:3.0:1790895493.967320:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1790895493.967339:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895493.967458:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+53:11585:x1877889741051904:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 548us (5787us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895493.967467:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 202 00000100:00100000:3.0:1790895493.984844:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895493.985168:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741052160 00000100:00100000:2.0:1790895493.985179:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741052160 00000100:00100000:2.0:1790895493.985255:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:2.0:1790895493.985267:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+53:11585:x1877889741052160:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895493.985536:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+54:11585:x1877889741052160:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 270us (702us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1790895493.985544:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 57 00000100:00100000:2.0:1790895494.136822:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895494.136956:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741052288 00000100:00100000:1.0:1790895494.136968:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741052288 00000100:00100000:1.0:1790895494.137026:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 203 00000100:00100000:1.0:1790895494.137036:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+54:11595:x1877889741052288:12345-192.168.201.54@tcp:34:lfs.0 00010000:00010000:1.0:1790895494.137115:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137255:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137272:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137289:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137313:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137319:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137407:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137416:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137423:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895494.137464:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137477:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137484:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137490:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137497:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895494.137501:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137508:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137527:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895494.137530:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895494.137535:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137541:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137564:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.137570:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138101:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138109:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895494.138112:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138118:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138127:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310cb5f00) 00010000:00010000:1.0:1790895494.138130:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895494.138142:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138150:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138176:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138182:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138189:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138194:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895494.138197:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138203:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138211:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895494.138213:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895494.138217:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.138222:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895494.138305:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+54:11595:x1877889741052288:12345-192.168.201.54@tcp:34:lfs.0 Request processed in 1269us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895494.138313:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 203 00000100:00100000:0.0:1790895494.202946:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895494.203033:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741052544 00000100:00100000:1.0:1790895494.203044:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741052544 00000100:00100000:1.0:1790895494.203104:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 204 00000100:00100000:1.0:1790895494.203143:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+54:11598:x1877889741052544:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895494.203168:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895494.203187:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fe6 expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203258:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203271:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203282:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203296:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203303:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203310:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203441:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203746:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203754:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895494.203774:0:12417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1790895494.203908:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203917:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203924:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203930:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895494.203935:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203943:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203956:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895494.203960:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895494.203965:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203971:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf94e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203986:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.203993:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204008:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204014:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895494.204017:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204024:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204032:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf310cb5f00) 00010000:00010000:1.0:1790895494.204035:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895494.204037:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204043:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf94e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204099:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf94da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 57 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204113:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 56 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.204120:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895494.204122:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895494.204125:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c400, rc 0) 00000100:00100000:1.0:1790895494.205037:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11598:x1877889741052544:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1903us (2105us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1790895494.205059:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 204 00000100:00100000:3.0:1790895494.211500:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.211663:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741052672 00000100:00100000:0.0:1790895494.211673:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741052672 00000100:00100000:0.0:1790895494.211736:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 205 00000100:00100000:0.0:1790895494.211748:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11598:x1877889741052672:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:0.0:1790895494.211817:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211836:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211849:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211913:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211921:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211927:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211944:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895494.211948:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211955:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211967:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.211971:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1790895494.211989:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.211996:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf94fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895494.212076:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11598:x1877889741052672:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 329us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895494.212084:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 205 00000100:00100000:3.0:1790895494.213806:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.216912:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741052928 00000100:00100000:0.0:1790895494.216939:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741052928 00000100:00100000:0.0:1790895494.216999:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 58 00000100:00100000:0.0:1790895494.217008:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+56:11598:x1877889741052928:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:0.0:1790895494.217298:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11598:x1877889741052928:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 289us (3501us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1790895494.217306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 58 00000100:00100000:1.0:1790895494.302649:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.302818:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741053184 00000100:00100000:0.0:1790895494.302828:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741053184 00000100:00100000:0.0:1790895494.302911:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 206 00000100:00100000:0.0:1790895494.302922:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11608:x1877889741053184:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:0.0:1790895494.302947:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895494.302951:0:5832:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1790895494.302976:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf947f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fca expref: 57 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.302995:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895494.303001:0:5832:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1790895494.303014:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9504 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2fed expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.303147:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.303161:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 57 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.303169:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.303201:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 57 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.303227:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 57 pid: 12417 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895494.303240:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758864640:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895494.303341:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305962180 going to sleep for 11 seconds 00000100:00100000:3.0:1790895494.306542:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895494.306643:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741053312 00000100:00100000:2.0:1790895494.306653:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741053312 00010000:00010000:2.0:1790895494.306706:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 58 pid: 12417 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895494.306751:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:2.0:1790895494.306761:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+58:2362:x1877889741053312:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895494.306777:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895494.306783:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 58 pid: 12417 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.306808:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 58 pid: 12417 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.306829:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:2.0:1790895494.306834:0:5817:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.306843:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.306851:0:5817:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.306921:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895494.306967:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+58:2362:x1877889741053312:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 208us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895494.306975:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 78 00010000:00010000:0.0:1790895494.307313:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf94ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fe6 expref: 57 pid: 12417 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895494.307333:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758864640:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895494.307368:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.307379:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.307397:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895494.307418:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1790895494.307589:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9504 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 58 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.307605:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 57 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.307613:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.307616:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1790895494.307619:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d800, rc 0) 00000100:00100000:0.0:1790895494.307653:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11608:x1877889741053184:12345-192.168.201.54@tcp:101:bash.0 Request processed in 4734us (5014us total) trans 4294967499 rc 0/0 00000100:00100000:0.0:1790895494.307660:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 206 00000100:00100000:3.0:1790895494.309946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.310066:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741053568 00000100:00100000:0.0:1790895494.310076:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741053568 00000100:00100000:0.0:1790895494.310133:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 207 00000100:00100000:0.0:1790895494.310143:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+57:11608:x1877889741053568:12345-192.168.201.54@tcp:36:bash.0 00010000:00010000:0.0:1790895494.310395:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.310413:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.310424:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895494.310500:0:5831:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:0.0:1790895494.310524:0:5831:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040ad397d reply state 00000000aceb48c0 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895494.310534:0:5831:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790895494.310617:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+60:11608:x1877889741053568:12345-192.168.201.54@tcp:36:bash.0 Request processed in 476us (676us total) trans 4294967501 rc 0/0 00000100:00100000:0.0:1790895494.310632:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 207 00000020:00080000:0.0:1790895494.310637:0:5831:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790895494.312319:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.312334:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.312340:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.312357:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895494.312361:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.312369:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.312384:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.312387:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895494.312392:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.312399:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9519 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895494.330778:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895494.331030:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741053696 00000100:00100000:2.0:1790895494.331050:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741053696 00000100:00100000:2.0:1790895494.331116:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 208 00000100:00100000:2.0:1790895494.331127:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+59:11608:x1877889741053696:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:2.0:1790895494.331152:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895494.331174:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf9520 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ff4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.331261:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.331276:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.331284:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.331316:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 60 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.331418:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 60 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895494.331432:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758864768:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895494.331541:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306098f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895494.335716:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.335820:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741053824 00000100:00100000:0.0:1790895494.335831:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741053824 00010000:00010000:0.0:1790895494.335917:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 61 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895494.335952:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 79 00000100:00100000:0.0:1790895494.335962:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+61:2362:x1877889741053824:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895494.335988:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895494.335995:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 61 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.336023:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 61 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.336055:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.336061:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.336071:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.336078:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.336097:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895494.336158:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+61:2362:x1877889741053824:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 198us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895494.336167:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 79 00010000:00010000:2.0:1790895494.338136:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d800/0x7911a98710cf950b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fed expref: 60 pid: 5832 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895494.338161:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405a3100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758864768:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895494.338187:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.338197:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.338202:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895494.338248:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1790895494.338252:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895494.338272:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.338316:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84ea00/0x7911a98710cf9520 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.338332:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895494.338341:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:2.0:1790895494.338344:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895494.338348:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f200, rc 0) 00000100:00100000:2.0:1790895494.338427:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+59:11608:x1877889741053696:12345-192.168.201.54@tcp:101:bash.0 Request processed in 7301us (7659us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895494.338447:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 208 00000100:00100000:3.0:1790895494.342840:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.343034:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741054080 00000100:00100000:0.0:1790895494.343047:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741054080 00000100:00100000:0.0:1790895494.343105:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:0.0:1790895494.343116:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+59:11608:x1877889741054080:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:0.0:1790895494.343758:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+60:11608:x1877889741054080:12345-192.168.201.54@tcp:35:bash.0 Request processed in 639us (923us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1790895494.343766:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 59 00000100:00100000:3.0:1790895494.436161:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.436314:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741054208 00000100:00100000:0.0:1790895494.436325:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741054208 00000100:00100000:0.0:1790895494.436405:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 209 00000100:00100000:0.0:1790895494.436418:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+60:11614:x1877889741054208:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895494.436440:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895494.436461:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf952e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc2ffb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.436530:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9535 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.436544:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.436584:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895494.436628:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1790895494.436632:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895494.436652:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9535 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.436675:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf952e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ffb expref: 62 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.436710:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9535 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ffb expref: 61 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.436719:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895494.436722:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895494.436726:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c200, rc 0) 00000100:00100000:0.0:1790895494.436791:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+61:11614:x1877889741054208:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 376us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895494.436798:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 209 00000100:00100000:3.0:1790895494.445674:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.445833:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741054336 00000100:00100000:0.0:1790895494.445845:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741054336 00000100:00100000:0.0:1790895494.445950:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 210 00000100:00100000:0.0:1790895494.445962:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3100efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+61:11614:x1877889741054336:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895494.445983:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895494.446001:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf953c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3002 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446064:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446079:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446091:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446108:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446129:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446136:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446226:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9551 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446235:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446243:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895494.446284:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1790895494.446289:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895494.446311:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446324:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9551 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446333:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446353:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446360:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446376:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895494.446381:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446389:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446402:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:0.0:1790895494.446405:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895494.446410:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446416:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf9543 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446441:0:7639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446448:0:7639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446454:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446459:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895494.446461:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446467:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446485:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf31037c700) 00010000:00010000:0.0:1790895494.446487:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895494.446490:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446497:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf954a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446527:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf953c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3002 expref: 63 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446541:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9551 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3002 expref: 62 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.446559:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.446561:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895494.446564:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895494.447529:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3100efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11614:x1877889741054336:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 658us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895494.447543:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 210 00000100:00100000:2.0:1790895494.452033:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895494.452087:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.452168:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741054720 00000100:00100000:0.0:1790895494.452181:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741054720 00000100:00100000:0.0:1790895494.452256:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:0.0:1790895494.452267:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+62:2362:x1877889741054720:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895494.452286:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895494.452318:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf9551 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3002 expref: 62 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.452367:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.452372:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895494.452457:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+61:2362:x1877889741054720:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 192us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895494.452465:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1790895494.455279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741054592 00000100:00100000:3.0:1790895494.455294:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741054592 00000100:00100000:3.0:1790895494.455473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 211 00000100:00100000:3.0:1790895494.455484:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+61:11614:x1877889741054592:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895494.455505:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895494.455525:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9558 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3009 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.456997:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.457023:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.457254:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.457304:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.457338:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 62 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895494.457353:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3100edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758864896:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895494.457477:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf30595bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895494.461940:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895494.462565:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3100edc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758864896:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895494.462593:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895494.462905:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741054848 00000100:00100000:0.0:1790895494.462914:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741054848 00010000:00010000:0.0:1790895494.462951:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 63 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895494.462983:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 80 00000100:00100000:0.0:1790895494.462993:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+63:2362:x1877889741054848:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895494.463010:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895494.463018:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 63 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.463055:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 63 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.463078:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf9527 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ff4 expref: 63 pid: 5833 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.463094:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.463098:0:11170:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.463124:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.463131:0:11170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.463160:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895494.463216:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+62:2362:x1877889741054848:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 223us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895494.463224:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 80 00010000:00010000:3.0:1790895494.464328:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.464350:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895494.464372:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1790895494.464544:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf9558 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 63 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.464576:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 62 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.464600:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:3.0:1790895494.464603:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1790895494.464606:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167da00, rc 0) 00000100:00100000:3.0:1790895494.464779:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11614:x1877889741054592:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 9295us (12756us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1790895494.464787:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 211 00000100:00100000:2.0:1790895494.473409:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895494.473490:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741055104 00000100:00100000:0.0:1790895494.473500:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741055104 00000100:00100000:0.0:1790895494.473566:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1790895494.473575:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306507450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11614:x1877889741055104:12345-192.168.201.54@tcp:103:lfs.0 00010000:00010000:0.0:1790895494.473592:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895494.473616:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf94be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fdf expref: 62 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895494.473646:0:5817:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895494.473652:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895494.473705:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306507450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+61:11614:x1877889741055104:12345-192.168.201.54@tcp:103:lfs.0 Request processed in 131us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895494.473712:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:1.0:1790895494.477566:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895494.477644:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741055232 00000100:00100000:3.0:1790895494.477656:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741055232 00000100:00100000:3.0:1790895494.477711:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 212 00000100:00100000:3.0:1790895494.477721:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+61:11614:x1877889741055232:12345-192.168.201.54@tcp:58:lfs.0 00010000:00010000:3.0:1790895494.477825:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.477843:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895494.477890:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790895494.478064:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1790895494.478142:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+61:11614:x1877889741055232:12345-192.168.201.54@tcp:58:lfs.0 Request processed in 422us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895494.478150:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 212 00000100:00100000:2.0:1790895494.480017:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895494.480195:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741055360 00000100:00100000:1.0:1790895494.480205:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741055360 00000100:00100000:1.0:1790895494.480258:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 213 00000100:00100000:1.0:1790895494.480268:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+61:11614:x1877889741055360:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895494.480287:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895494.480308:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3010 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.480372:0:7639:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.480382:0:7639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 62 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.480400:0:7639:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.480412:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 62 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.480425:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895494.480428:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790895494.480432:0:7639:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 62 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895494.480458:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91cc00, rc 0) 00000100:00100000:1.0:1790895494.480517:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11614:x1877889741055360:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 250us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895494.480524:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 213 00000100:00100000:1.0:1790895494.616335:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3100ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758865152:0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.616423:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895494.616506:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758865664:0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.616535:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895494.616575:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790895494.616582:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3100edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758865024:0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.616624:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895494.616645:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3100eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758865536:0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.616666:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895494.616809:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865664 00000100:00100000:3.0:1790895494.616817:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865664 00000100:00100000:3.0:1790895494.616894:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790895494.616905:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758865664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895494.616975:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758865664:12345-0@lo:400:kworker.0 Request processed in 72us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895494.616983:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1790895494.617008:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865024 00000100:00100000:3.0:1790895494.617012:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865024 00000100:00100000:1.0:1790895494.617142:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865152 00000100:00100000:1.0:1790895494.617146:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865152 00000100:00100000:1.0:1790895494.617172:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865536 00000100:00100000:1.0:1790895494.617175:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865536 00000100:00100000:1.0:1790895494.617200:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790895494.617207:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758865152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.617240:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758865152:12345-0@lo:400:kworker.0 Request processed in 34us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895494.617246:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1790895494.617258:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790895494.617264:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758865536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.617300:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758865536:12345-0@lo:400:kworker.0 Request processed in 37us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895494.617307:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1790895494.617363:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3100eed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758865536:0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.617375:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3100ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758865152:0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.617385:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758865664:0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.617421:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1790895494.617428:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758865024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.617473:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3309:x1877889758865024:12345-0@lo:400:kworker.0 Request processed in 46us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895494.617479:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1790895494.617510:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3100edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:221ad158-1cb7-4652-832e-1e3667184cca:3309:1877889758865024:0@lo:400:kworker.0 00000100:00100000:0.0:1790895494.617744:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3100ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758865408:0@lo:400:kworker.0 00000100:00100000:0.0:1790895494.617777:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895494.617817:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790895494.617823:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3100ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758865280:0@lo:400:kworker.0 00000100:00100000:0.0:1790895494.617855:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895494.617952:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865408 00000100:00100000:1.0:1790895494.617957:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865408 00000100:00100000:1.0:1790895494.617994:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1790895494.618000:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758865408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895494.618045:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758865408:12345-0@lo:400:kworker.0 Request processed in 34us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895494.618051:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1790895494.618329:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865280 00000100:00100000:3.0:1790895494.618344:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865280 00000100:00100000:3.0:1790895494.618380:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1790895494.618388:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758865280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895494.618435:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758865280:12345-0@lo:400:kworker.0 Request processed in 48us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895494.618451:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1790895494.618631:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3100ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758865280:0@lo:400:kworker.0 00000100:00100000:0.0:1790895494.618642:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3100ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758865408:0@lo:400:kworker.0 00000004:00080000:2.0:1790895494.618898:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 367586039024ns, next at 368586036539ns, rc = 0 00000100:00100000:2.0:1790895494.618920:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758865792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895494.618950:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790895494.618986:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1790895494.618991:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895494.619170:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865792 00000100:00100000:3.0:1790895494.619175:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865792 00000100:00100000:3.0:1790895494.619209:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790895494.619217:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758865792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895494.619243:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895494.619286:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758865792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895494.619291:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1790895494.619497:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758865792:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790895494.872215:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1790895495.128107:0:7922:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 368095246212ns, next at 369095243376ns, rc = 0 00000100:00100000:0.0:1790895495.128161:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758865920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1790895495.128233:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895495.128409:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758865920 00000100:00100000:3.0:1790895495.128529:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758865920 00000100:00100000:3.0:1790895495.128602:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790895495.128620:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758865920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895495.128655:0:6692:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895495.128710:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1877889758865920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.128725:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1790895495.128884:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790895495.129032:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758865920:0@lo:13:osp-pre-1-0.0 00000040:00080000:0.0:1790895495.384212:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1790895495.384223:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1790895495.384259:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1790895495.384265:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790895495.384406:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3405e4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758866048:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790895495.384653:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305962180 going to sleep for 11 seconds 00000100:00100000:0.0:1790895495.388387:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3405e4a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758866048:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1790895495.391567:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.391826:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741055488 00000100:00100000:1.0:1790895495.391836:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741055488 00000100:00100000:1.0:1790895495.391949:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 214 00000100:00100000:1.0:1790895495.391975:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11615:x1877889741055488:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790895495.392009:0:12417:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:2.0:1790895495.392074:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895495.392120:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11615:x1877889741055488:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 147us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895495.392128:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 214 00000100:00100000:2.0:1790895495.398352:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.402397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741055616 00000100:00100000:1.0:1790895495.402591:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741055616 00000100:00100000:1.0:1790895495.402676:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 215 00000100:00100000:1.0:1790895495.402688:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11615:x1877889741055616:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790895495.402762:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.402790:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.402804:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.402820:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.402828:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.402835:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.402887:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404062:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404071:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895495.404115:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1790895495.404120:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895495.404134:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404144:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404151:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404158:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404164:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895495.404168:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404176:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404188:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:1.0:1790895495.404192:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895495.404196:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404215:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf957b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404232:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404238:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404244:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404249:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895495.404253:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404259:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404267:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8cf310cb5f00) 00010000:00010000:1.0:1790895495.404270:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895495.404273:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404278:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c400/0x7911a98710cf9582 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404293:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404299:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404311:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.404321:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895495.407522:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.407551:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.407569:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895495.407573:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895495.407579:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.407586:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9589 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.410016:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11615:x1877889741055616:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 Request processed in 7320us (11664us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895495.410031:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 215 00000100:00100000:2.0:1790895495.416047:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.416199:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741055872 00000100:00100000:1.0:1790895495.416210:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741055872 00000100:00100000:1.0:1790895495.416275:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 216 00000100:00100000:1.0:1790895495.416286:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+62:11615:x1877889741055872:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895495.416309:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895495.416336:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9590 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3017 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416449:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416466:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416478:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895495.416490:0:5831:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1790895495.416647:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416655:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416662:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416668:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895495.416672:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416680:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416707:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895495.416710:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1790895495.416717:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416733:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf9597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416778:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9590 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3017 expref: 64 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416788:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:1.0:1790895495.416791:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790895495.416795:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9590 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3017 expref: 64 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.416804:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d800, rc 0) 00000100:00100000:1.0:1790895495.416885:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+63:11615:x1877889741055872:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 601us (847us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1790895495.416892:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 216 00000100:00100000:3.0:1790895495.426389:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.426735:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741056000 00000100:00100000:1.0:1790895495.426748:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741056000 00000100:00100000:1.0:1790895495.426820:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 217 00000100:00100000:1.0:1790895495.426833:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+63:11615:x1877889741056000:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790895495.426908:0:7639:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790895495.427020:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+63:11615:x1877889741056000:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 190us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895495.427029:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 217 00000100:00100000:3.0:1790895495.436182:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.437937:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741056256 00000100:00100000:1.0:1790895495.437955:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741056256 00000100:00100000:1.0:1790895495.438036:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 218 00000100:00100000:1.0:1790895495.438058:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+63:11615:x1877889741056256:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895495.438082:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895495.438085:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1790895495.438124:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9535 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ffb expref: 63 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.438151:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895495.438158:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895495.438173:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf95a5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc301e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790895495.459747:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:0.0:1790895495.460038:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf95ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.460057:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf95ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.460070:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf95ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.460141:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf95a5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc301e expref: 65 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.460190:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf95ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc301e expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.460200:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:0.0:1790895495.460203:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1790895495.460207:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895495.460281:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+64:11615:x1877889741056256:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 22224us (24113us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1790895495.460290:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 218 00000100:00100000:2.0:1790895495.471307:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.471788:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741056512 00000100:00100000:1.0:1790895495.471799:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741056512 00000100:00100000:1.0:1790895495.471902:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 219 00000100:00100000:1.0:1790895495.471917:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30fc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+64:11615:x1877889741056512:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790895495.471999:0:12417:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895495.472032:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf95ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc301e expref: 64 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472055:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c700) 00010000:00010000:1.0:1790895495.472067:0:12417:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895495.472096:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472115:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472125:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472221:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472231:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472238:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472311:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472319:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472327:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472334:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895495.472339:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472347:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.472356:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895495.472358:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895495.473802:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473815:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91da00/0x7911a98710cf95ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473855:0:12417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473889:0:12417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473895:0:12417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473901:0:12417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895495.473905:0:12417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473912:0:12417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473940:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xae6c89bf (ffff8cf310cb5f00) 00010000:00010000:1.0:1790895495.473944:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895495.473948:0:12417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.473953:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf95c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xae6c89bf bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895495.481142:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30fc00380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+63:11615:x1877889741056512:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 9211us (9827us total) trans 0 rc -2/-2 00000100:00100000:2.0:1790895495.481159:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 219 00000100:00100000:3.0:1790895495.488830:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895495.488993:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741056640 00000100:00100000:0.0:1790895495.489002:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741056640 00000100:00100000:0.0:1790895495.489068:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 220 00000100:00100000:0.0:1790895495.489078:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+63:11615:x1877889741056640:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895495.489098:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895495.489121:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf95c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3025 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.489157:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.489171:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.489182:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.489282:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf95c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 65 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.489307:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 64 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.489316:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:0.0:1790895495.489319:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895495.489322:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d600, rc 0) 00000100:00100000:0.0:1790895495.489963:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+64:11615:x1877889741056640:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 883us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895495.489971:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 220 00000100:00100000:3.0:1790895495.498374:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895495.498568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741056896 00000100:00100000:0.0:1790895495.498579:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741056896 00000100:00100000:0.0:1790895495.498641:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 221 00000100:00100000:0.0:1790895495.498652:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+64:11615:x1877889741056896:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1790895495.498753:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.498775:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.498789:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790895495.499135:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:0.0:1790895495.499237:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002bf5290f reply state 000000005a1deb38 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895495.499247:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1790895495.499359:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+66:11615:x1877889741056896:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 708us (996us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1790895495.499366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 221 00000100:00100000:3.0:1790895495.504581:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.504724:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741057024 00000100:00100000:2.0:1790895495.504735:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741057024 00000100:00100000:2.0:1790895495.504805:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 222 00000100:00100000:2.0:1790895495.504816:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+66:11615:x1877889741057024:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895495.504848:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895495.504945:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc302c expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.505013:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 67 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.505035:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 67 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.505057:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:2.0:1790895495.505061:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790895495.505066:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f200, rc 0) 00000100:00100000:2.0:1790895495.505122:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+67:11615:x1877889741057024:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 308us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895495.505129:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 222 00010000:00010000:0.0:1790895495.505784:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.505797:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.505805:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.505811:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895495.505815:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.505824:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.505840:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:0.0:1790895495.505843:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790895495.505848:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.505855:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7de00/0x7911a98710cf95d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895495.509640:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.510091:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741057152 00000100:00100000:3.0:1790895495.510104:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741057152 00000100:00100000:3.0:1790895495.510186:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:3.0:1790895495.510198:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2361:x1877889741057152:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790895495.510663:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301218a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2361:x1877889741057152:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 467us (1032us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1790895495.510671:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00080000:2.0:1790895495.515451:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895495.520905:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.521088:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741057408 00000100:00100000:2.0:1790895495.521099:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741057408 00000100:00100000:2.0:1790895495.521152:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:2.0:1790895495.521163:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+66:11615:x1877889741057408:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790895495.521390:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+67:11615:x1877889741057408:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 229us (495us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1790895495.521398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 60 00000100:00100000:0.0:1790895495.537266:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.537398:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741057664 00000100:00100000:3.0:1790895495.537514:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741057664 00000100:00100000:3.0:1790895495.537590:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 223 00000100:00100000:3.0:1790895495.537600:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+67:11615:x1877889741057664:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790895495.537756:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+67:11615:x1877889741057664:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 156us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.537764:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 223 00000100:00100000:2.0:1790895495.551708:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.555655:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741057792 00000100:00100000:3.0:1790895495.555676:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741057792 00000100:00100000:3.0:1790895495.555895:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 224 00000100:00100000:3.0:1790895495.555908:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+67:11615:x1877889741057792:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895495.555958:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895495.555978:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf95e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3033 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.556076:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf95eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.556091:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf95eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.556101:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf95eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895495.556137:0:7639:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895495.556156:0:7639:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf95eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.556182:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf95e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3033 expref: 69 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.556203:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf95eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3033 expref: 68 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.556211:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:3.0:1790895495.556215:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1790895495.556219:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ce00, rc 0) 00000100:00100000:3.0:1790895495.556286:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+68:11615:x1877889741057792:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 382us (4593us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.556294:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 224 00000100:00100000:0.0:1790895495.565288:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.567977:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741057920 00000100:00100000:1.0:1790895495.567993:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741057920 00000100:00100000:1.0:1790895495.568071:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:1.0:1790895495.568082:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3405e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+10:2362:x1877889741057920:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895495.568115:0:8701:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895495.568135:0:8701:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc303a expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1790895495.568163:0:8701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abee587, blocks: 0x1 00010000:00010000:1.0:1790895495.568184:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=368s v=(0 0) 00010000:00010000:1.0:1790895495.568189:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895495.568199:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 11 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.568217:0:8701:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 11 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.568229:0:8701:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91ce00, rc 0) 00000100:00100000:1.0:1790895495.568293:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3405e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+11:2362:x1877889741057920:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 213us (3015us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895495.568300:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:0.0:1790895495.571821:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.571959:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741058176 00000100:00100000:3.0:1790895495.571970:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741058176 00000100:00100000:3.0:1790895495.572035:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 225 00000100:00100000:3.0:1790895495.572045:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+68:11615:x1877889741058176:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790895495.572142:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+68:11615:x1877889741058176:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.572149:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 225 00000100:00100000:2.0:1790895495.579290:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.582078:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741058304 00000100:00100000:1.0:1790895495.582095:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741058304 00000100:00100000:0.0:1790895495.582306:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:0.0:1790895495.582318:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf301219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+11:11615:x1877889741058304:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895495.582352:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895495.582372:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3041 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.582422:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 12 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.582432:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895495.582437:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895495.582444:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.582483:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 12 pid: 8701 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.582516:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 12 pid: 8701 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895495.582543:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf2018aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758866176:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895495.582661:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895495.589094:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.589269:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf2018aea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6688:1877889758866176:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895495.589320:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.589341:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7ca00, rc 0) 00000100:00100000:2.0:1790895495.589425:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf301219180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+12:11615:x1877889741058304:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 7108us (10144us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895495.589433:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:1.0:1790895495.589679:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741058432 00000100:00100000:1.0:1790895495.589689:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741058432 00010000:00010000:1.0:1790895495.589729:0:11170:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 12 pid: 8701 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.589776:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 81 00000100:00100000:1.0:1790895495.589787:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+12:2361:x1877889741058432:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895495.589813:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895495.589841:0:11170:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 12 pid: 8701 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.589928:0:11170:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 12 pid: 8701 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.589955:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf95f2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc303a expref: 12 pid: 8701 timeout: 468 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.589969:0:11170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895495.589974:0:11170:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895495.589982:0:11170:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.589992:0:11170:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.590027:0:11170:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 11 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.590042:0:11170:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11170:1877889758866304:192.168.201.54@tcp:105: 00000100:00100000:1.0:1790895495.590099:0:11170:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e65e40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895495.593585:0:11170:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:11170:1877889758866304:192.168.201.54@tcp:105: 00010000:00010000:1.0:1790895495.593610:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895495.593672:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336be7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+11:2361:x1877889741058432:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 3887us (4588us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895495.593682:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 81 00000100:00100000:3.0:1790895495.601029:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895495.601175:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741058560 00000100:00100000:0.0:1790895495.601186:0:6696:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741058560 00002000:00100000:0.0:1790895495.601245:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cf336e36a00 x1877889741058560/t0(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:21/0 lens 504/0 e 0 to 0 dl 1790895506 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895495.601257:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf336e36a00 with x1877889741058560 ext(0->12) 00002000:00010000:0.0:1790895495.601274:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf336e36a00 00000100:00100000:0.0:1790895495.601313:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:0.0:1790895495.601323:0:6696:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+11:2362:x1877889741058560:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1790895495.602213:0:6696:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+13:2362:x1877889741058560:12345-192.168.201.54@tcp:4:lhsmtool_posix.0 Request processed in 888us (1355us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1790895495.602224:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00002000:00100000:0.0:1790895495.602233:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff8cf336e36a00 x1877889741058560/t4294967320(0) o4->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:21/0 lens 504/448 e 0 to 0 dl 1790895506 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895495.602242:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf336e36a00 with x1877889741058560 ext(0->12) 00002000:00010000:0.0:1790895495.602248:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf336e36a00 00000100:00100000:0.0:1790895495.605689:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.606538:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741058688 00000100:00100000:2.0:1790895495.606553:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741058688 00000100:00100000:2.0:1790895495.606632:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 226 00000100:00100000:2.0:1790895495.606642:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3368bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+68:11615:x1877889741058688:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1790895495.684230:0:12425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1790895495.684262:0:12425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000020:00080000:1.0:1790895495.684285:0:12425:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf336f3b900 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1790895495.684290:0:12425:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f9c5500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf336f3ba80 00000020:00080000:1.0:1790895495.684294:0:12425:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f9c5d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf33faa2c00 00000004:00080000:1.0:1790895495.684316:0:12425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1790895495.684340:0:12425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1790895495.684350:0:12425:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf318e659c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1790895495.684353:0:12425:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f922800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf318e65600 00000020:00080000:1.0:1790895495.684366:0:12425:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f922400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf33a821800 00000001:00080000:1.0:1790895495.684396:0:12425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:1.0:1790895495.684401:0:12425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000100:00100000:3.0:1790895495.684834:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1790895495.684855:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758866432:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1790895495.685083:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895495.685155:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758866432 00000100:00100000:3.0:1790895495.685163:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758866432 00000100:00100000:3.0:1790895495.685206:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790895495.685215:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1877889758866432:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1790895495.685241:0:8701:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1790895495.685273:0:8701:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6abee586, atime: 0x6abee586, ctime: 0x6abee586, blocks: 0x1 00010000:00010000:3.0:1790895495.685281:0:8701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.685298:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=368s v=(0 0) 00010000:00010000:3.0:1790895495.685303:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895495.685311:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.685325:0:8701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.685352:0:8701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.685371:0:8701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.685388:0:8701:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1790895495.686213:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3368bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+27:11615:x1877889741058688:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 Request processed in 79569us (80531us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895495.686224:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 226 00000020:00080000:0.0:1790895495.686253:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1790895495.686402:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1790895495.700191:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895495.700222:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758866560:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1790895495.700335:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895495.700418:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758866560 00000100:00100000:0.0:1790895495.700427:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758866560 00000100:00100000:0.0:1790895495.700472:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1790895495.700481:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3308:x1877889758866560:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1790895495.700510:0:6690:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:0.0:1790895495.700542:0:6690:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.700571:0:6690:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.700580:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1790895495.700584:0:6690:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895495.700589:0:6690:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.700622:0:6690:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 12 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.700650:0:6690:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 12 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895495.700661:0:6690:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1877889758866688:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895495.700718:0:6690:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895495.700816:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895495.700916:0:6691:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1790895495.700923:0:6691:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1790895495.701074:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741058816 00000100:00100000:0.0:1790895495.701078:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741058816 00000100:00100000:0.0:1790895495.701157:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 67 00000100:00100000:0.0:1790895495.701166:0:12529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+13:2362:x1877889741058816:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1790895495.703771:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1877889758866432:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18547us (18679us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1790895495.703785:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:3.0:1790895495.703823:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895495.703831:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.703843:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895495.703848:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.703895:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.703918:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.703926:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b9e33d/0x7911a98710cf9600 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.703956:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895495.703958:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895495.703960:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895495.713750:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.714701:0:6690:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6690:1877889758866688:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895495.714739:0:6690:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1790895495.716797:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf336e34380/2, rc 0, transno 4294967310 00000100:00100000:1.0:1790895495.716810:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758866432:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1790895495.720669:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741058944 00000100:00100000:0.0:1790895495.720684:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741058944 00010000:00010000:0.0:1790895495.720743:0:5817:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 14 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895495.722072:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 82 00000100:00100000:0.0:1790895495.722086:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+14:2362:x1877889741058944:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895495.722103:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895495.722111:0:5817:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 14 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.722142:0:5817:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 14 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.722547:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ab57a2e/0x7911a98710cf93c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.54@tcp remote: 0x8300040986fc2fa0 expref: 14 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.722566:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895495.722570:0:5817:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1790895495.722576:0:5817:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.722585:0:5817:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.722622:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895495.722690:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+13:2362:x1877889741058944:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 608us (8952us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895495.722711:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 82 00010000:00010000:2.0:1790895495.731680:0:6690:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.731698:0:6690:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.731711:0:6690:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.731719:0:6690:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.731745:0:6690:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790895495.737306:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1877889758866560:12345-0@lo:6:osp-syn-0-0.0 Request processed in 36815us (36970us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1790895495.737342:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1790895495.739501:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf3369e2d80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1790895495.739535:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758866560:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1790895495.742266:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895495.742278:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.742292:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895495.742296:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.742307:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.742327:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.742334:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3225f6f/0x7911a98710cf9607 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6690 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.742356:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895495.742358:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895495.742360:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790895495.792451:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000001:00080000:1.0:1790895495.792477:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000100:00100000:0.0:1790895495.792693:0:12529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741058816:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 Request processed in 91522us (91870us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895495.792704:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 67 00000100:00100000:1.0:1790895495.796633:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.796812:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741059200 00000100:00100000:3.0:1790895495.796827:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741059200 00000100:00100000:3.0:1790895495.797003:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 227 00000100:00100000:3.0:1790895495.797020:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11615:x1877889741059200:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790895495.797088:0:7639:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895495.797117:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf95eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3033 expref: 21 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.797137:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:3.0:1790895495.797142:0:7639:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895495.797168:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.797181:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.797191:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790895495.797422:0:7639:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a0b0b32f reply state 000000000bb7fc6b transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895495.797445:0:7639:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790895495.797604:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+22:11615:x1877889741059200:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 590us (981us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1790895495.797611:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 227 00010000:00010000:0.0:1790895495.800290:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.800306:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.800314:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.800320:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167d000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895495.800325:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.800334:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.800351:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:0.0:1790895495.800354:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895495.800359:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.800366:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf960e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.812973:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895495.813066:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741059328 00000100:00100000:0.0:1790895495.813076:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741059328 00000100:00100000:0.0:1790895495.813145:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:0.0:1790895495.813159:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741059328:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1790895495.813388:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1790895495.813393:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1790895494 00002000:00010000:0.0:1790895495.813396:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1790895494 00002000:00010000:0.0:1790895495.813398:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790895495 -> 1790895494 00002000:00010000:0.0:1790895495.813401:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1790895495.813481:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2362:x1877889741059328:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 325us (518us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1790895495.813490:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:1.0:1790895495.822710:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.822813:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741059584 00000100:00100000:3.0:1790895495.822825:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741059584 00000100:00100000:3.0:1790895495.823253:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 228 00000100:00100000:3.0:1790895495.823264:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+21:11615:x1877889741059584:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1790895495.823336:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.823366:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.823376:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.823426:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.823452:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 21 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895495.823466:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758866816:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895495.823570:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf30595b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895495.833175:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758866816:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895495.833245:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.846070:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.846392:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741059712 00000100:00100000:2.0:1790895495.846416:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741059712 00010000:00010000:2.0:1790895495.846461:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 22 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895495.846499:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 83 00000100:00100000:2.0:1790895495.846534:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+22:2361:x1877889741059712:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895495.846553:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895495.846561:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 22 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.846594:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 22 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.846617:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf95cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3025 expref: 22 pid: 5832 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.846636:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:2.0:1790895495.846643:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.846652:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.846660:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.846688:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895495.847059:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+21:2361:x1877889741059712:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 536us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895495.847067:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 83 00010000:00010000:3.0:1790895495.847211:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847220:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847247:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847254:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847261:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847267:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895495.847272:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847280:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847289:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:3.0:1790895495.847291:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1790895495.847295:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.847301:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9615 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895495.847350:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:11615:x1877889741059584:12345-192.168.201.54@tcp:55:lhsmtool_posix.0 Request processed in 24089us (24649us total) trans 0 rc -22/-22 00000100:00100000:3.0:1790895495.847367:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 228 00000100:00100000:2.0:1790895495.853446:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.854568:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741059840 00000100:00100000:3.0:1790895495.854594:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741059840 00000100:00100000:3.0:1790895495.854661:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:3.0:1790895495.854680:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2364:x1877889741059840:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1790895495.854851:0:8701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.854903:0:8701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.854910:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895495.854913:0:8701:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1790895495.854917:0:8701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.854945:0:8701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.854967:0:8701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 8 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895495.854978:0:8701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758866944:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895495.855224:0:8701:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf30595b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895495.858626:0:8701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8701:1877889758866944:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895495.858659:0:8701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895495.868603:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.868711:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741059968 00000100:00100000:1.0:1790895495.868722:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741059968 00010000:00010000:1.0:1790895495.868776:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 9 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.868823:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:1.0:1790895495.868833:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+9:2361:x1877889741059968:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895495.868849:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895495.868908:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 9 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.868936:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 9 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.868962:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003644fe09/0x7911a98710cf95f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3041 expref: 9 pid: 6688 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.868979:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790895495.868983:0:5816:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790895495.868989:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.868999:0:5816:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.869095:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895495.869155:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340631500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741059968:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 322us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895495.869173:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 84 00010000:00010000:3.0:1790895495.869473:0:8701:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869484:0:8701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869508:0:8701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869516:0:8701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869559:0:8701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869567:0:8701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895495.869571:0:8701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869581:0:8701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869615:0:8701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.869624:0:8701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a6e4725/0x7911a98710cf961c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895495.869686:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf2018aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2364:x1877889741059840:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 Request processed in 15013us (16249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.869696:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:2.0:1790895495.872565:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895495.872678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741060224 00000100:00100000:0.0:1790895495.872689:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741060224 00000100:00100000:0.0:1790895495.872753:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 229 00000100:00100000:0.0:1790895495.872762:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+20:11615:x1877889741060224:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1790895495.872841:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.872881:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.872894:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.873099:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.873126:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 21 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.873134:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.873165:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 21 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.873191:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 21 pid: 12417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895495.873205:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758867072:192.168.201.54@tcp:104: 00000100:00100000:0.0:1790895495.873287:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790895495.876023:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758867072:192.168.201.54@tcp:104: 00010000:00010000:0.0:1790895495.876052:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895495.877236:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.877365:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741060352 00000100:00100000:1.0:1790895495.877374:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741060352 00010000:00010000:1.0:1790895495.877471:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 22 pid: 12417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.877576:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 85 00000100:00100000:1.0:1790895495.877597:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+22:2362:x1877889741060352:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895495.877612:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895495.877619:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 22 pid: 12417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.877645:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 22 pid: 12417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.877666:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf95dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc302c expref: 22 pid: 12417 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.877682:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:1.0:1790895495.877687:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.877696:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.877703:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895495.877735:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895495.877792:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+21:2362:x1877889741060352:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 208us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895495.877805:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 85 00010000:00010000:0.0:1790895495.877929:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.877937:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895495.878152:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1790895495.878305:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1790895495.878373:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1790895495.878462:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758867200:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790895495.878517:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895495.878555:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790895495.878768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758867200 00000100:00100000:3.0:1790895495.878775:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758867200 00000100:00100000:3.0:1790895495.878820:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790895495.878828:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1877889758867200:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790895495.878930:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1877889758867200:12345-0@lo:1000:mdt00_002.0 Request processed in 103us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.878938:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790895495.879248:0:5833:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:0.0:1790895495.879255:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:0.0:1790895495.879274:0:5833:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cf3369e2d80 x1877889758866560/t4294967321(4294967321) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1790895511 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790895495.879286:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758867200:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1790895495.880325:0:5833:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1790895495.880395:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758867328:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1790895495.880440:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895495.880471:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b840 going to sleep for 11 seconds 00000100:00100000:3.0:1790895495.880643:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758867328 00000100:00100000:3.0:1790895495.880650:0:5836:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758867328 00000100:00100000:3.0:1790895495.880693:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790895495.880702:0:5836:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1877889758867328:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1790895495.881239:0:5836:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1877889758867328:12345-0@lo:1000:mdt00_002.0 Request processed in 537us (798us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1790895495.881246:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1790895495.881354:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5833:1877889758867328:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1790895495.881395:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881404:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881413:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881419:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895495.881423:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881430:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881446:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf31037c800) 00010000:00010000:0.0:1790895495.881456:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895495.881461:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881468:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d600/0x7911a98710cf962a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881497:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881504:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881510:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881514:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895495.881517:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881534:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881542:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895495.881545:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895495.881552:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 24 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881562:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 24 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881572:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 24 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.881618:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 24 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895495.881632:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758867456:192.168.201.54@tcp:105: 00000100:00100000:0.0:1790895495.881709:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b840 going to sleep for 11 seconds 00000100:00100000:0.0:1790895495.889372:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5833:1877889758867456:192.168.201.54@tcp:105: 00010000:00010000:0.0:1790895495.889407:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889420:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf956d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889459:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889473:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889484:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889496:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889502:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889509:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889545:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895495.889549:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889557:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889572:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895495.889576:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895495.889580:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889654:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d400/0x7911a98710cf9631 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889666:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889672:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889678:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889683:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895495.889686:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889692:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889714:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895495.889717:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895495.889720:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895495.889726:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf9623 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790895495.890985:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790895495.890992:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790895495.891505:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1790895495.891516:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790895495.891998:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+24:11615:x1877889741060224:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 19229us (19434us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1790895495.892020:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 229 00000020:00080000:0.0:1790895495.892026:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1790895495.892344:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.892484:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741060480 00000100:00100000:3.0:1790895495.892493:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741060480 00000100:00100000:3.0:1790895495.892551:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 61 00000100:00100000:3.0:1790895495.892561:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+24:11614:x1877889741060480:12345-192.168.201.54@tcp:49:lfs.0 00000100:00100000:3.0:1790895495.892685:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+24:11614:x1877889741060480:12345-192.168.201.54@tcp:49:lfs.0 Request processed in 126us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.892692:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 61 00010000:00010000:0.0:1790895495.896492:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895495.896666:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895495.896818:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.897005:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741060992 00000100:00100000:2.0:1790895495.897020:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741060992 00000100:00100000:2.0:1790895495.897078:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 230 00000100:00100000:2.0:1790895495.897088:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+24:11614:x1877889741060992:12345-192.168.201.54@tcp:58:lfs.0 00000040:00080000:2.0:1790895495.897441:0:7639:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1790895495.897538:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+24:11614:x1877889741060992:12345-192.168.201.54@tcp:58:lfs.0 Request processed in 450us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895495.897546:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 230 00000100:00100000:3.0:1790895495.899972:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741060736 00000100:00100000:3.0:1790895495.899986:0:5834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741060736 00000100:00100000:2.0:1790895495.900326:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 62 00000100:00100000:2.0:1790895495.900337:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+24:11615:x1877889741060736:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1790895495.901797:0:5834:0:(mdd_object.c:4178:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1790895495.902126:0:5834:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1790895495.902295:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.902314:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.902327:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.902339:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.902356:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.902362:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.902431:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1790895495.902559:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+26:11615:x1877889741060736:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 2221us (5897us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1790895495.902571:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 62 00000020:00080000:2.0:1790895495.902577:0:5834:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1790895495.908695:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895495.908713:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.908726:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895495.908730:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.908740:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.908770:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8cf310c7e000) 00010000:00010000:3.0:1790895495.908773:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1790895495.908778:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.908785:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f400/0x7911a98710cf9638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.910326:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895495.910332:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895495.910334:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895495.958249:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895495.958482:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741061120 00000100:00100000:3.0:1790895495.958506:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741061120 00000100:00100000:3.0:1790895495.958581:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 231 00000100:00100000:3.0:1790895495.958698:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+26:11617:x1877889741061120:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895495.958725:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895495.958746:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf963f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3048 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.958814:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.958830:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.958842:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959084:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959095:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959103:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959399:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959473:0:5832:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959481:0:5832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959535:0:5832:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.959562:0:5832:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 27 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895495.959577:0:5832:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758867584:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895495.959813:0:5832:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf30595b3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895495.964348:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.965044:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741061376 00000100:00100000:2.0:1790895495.965055:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741061376 00000100:00100000:2.0:1790895495.965120:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:2.0:1790895495.965132:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+28:6061:x1877889741061376:12345-192.168.201.54@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1790895495.965393:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+29:6061:x1877889741061376:12345-192.168.201.54@tcp:35:ldlm_bl.0 Request processed in 262us (1058us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1790895495.965410:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 63 00000100:00100000:3.0:1790895495.967727:0:5832:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5832:1877889758867584:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895495.967822:0:5832:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895495.971531:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895495.972228:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741061504 00000100:00100000:2.0:1790895495.972240:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741061504 00010000:00010000:2.0:1790895495.972282:0:5816:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 29 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895495.972377:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 86 00000100:00100000:2.0:1790895495.972387:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+29:2362:x1877889741061504:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895495.972429:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895495.972437:0:5816:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 29 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.972464:0:5816:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 29 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.972487:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf955f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3009 expref: 29 pid: 5833 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.972504:0:5816:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:2.0:1790895495.972508:0:5816:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.972533:0:5816:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.972542:0:5816:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895495.972580:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895495.972716:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+28:2362:x1877889741061504:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 330us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895495.972725:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 86 00010000:00010000:3.0:1790895495.972793:0:5832:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972801:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895495.972842:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1790895495.972846:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895495.972912:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972925:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972935:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972952:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972959:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972965:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895495.972970:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972977:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972986:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:3.0:1790895495.972989:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895495.972993:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.972998:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ce00/0x7911a98710cf9646 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973020:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973027:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973033:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973037:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895495.973047:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973054:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973062:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8cf3183e2800) 00010000:00010000:3.0:1790895495.973065:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895495.973068:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973074:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167de00/0x7911a98710cf964d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973113:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf963f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3048 expref: 28 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973127:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3048 expref: 27 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895495.973135:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:3.0:1790895495.973138:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790895495.973140:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167d000, rc 0) 00000100:00100000:3.0:1790895495.973179:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+27:11617:x1877889741061120:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 14485us (15023us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895495.973185:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 231 00000040:00080000:1.0:1790895496.925836:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1790895496.925851:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1790895496.926133:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1790895496.926142:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1790895496.926345:0:11685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758867712:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790895496.926490:0:11685:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3033ba6c0 going to sleep for 11 seconds 00010000:00010000:2.0:1790895496.926657:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895496.939181:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895496.939392:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741061632 00000100:00100000:0.0:1790895496.939406:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741061632 00000100:00100000:0.0:1790895496.939482:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 232 00000100:00100000:0.0:1790895496.939495:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+28:11628:x1877889741061632:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1790895496.939562:0:5833:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1790895496.939717:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+28:11628:x1877889741061632:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 223us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895496.939725:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 232 00000100:00100000:2.0:1790895496.940332:0:11685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1877889758867712:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1790895496.956424:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895496.959645:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741061888 00000100:00100000:2.0:1790895496.959669:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741061888 00000100:00100000:2.0:1790895496.959769:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 233 00000100:00100000:2.0:1790895496.959781:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+27:11628:x1877889741061888:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895496.959811:0:12417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895496.959843:0:12417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf965b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc304f expref: -99 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895496.960015:0:12417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9662 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895496.960035:0:12417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895496.960050:0:12417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9662 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12417 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895496.960066:0:12417:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1790895496.960257:0:12417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf965b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc304f expref: 30 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895496.960280:0:12417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9662 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc304f expref: 29 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895496.960290:0:12417:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:2.0:1790895496.960293:0:12417:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895496.960299:0:12417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e600, rc 0) 00000100:00100000:2.0:1790895496.960402:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+29:11628:x1877889741061888:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 623us (3995us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1790895496.960409:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 233 00000100:00100000:2.0:1790895496.983483:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895496.983572:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895496.986849:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741062144 00000100:00100000:3.0:1790895496.986927:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741062144 00000100:00100000:3.0:1790895496.987016:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 234 00000100:00100000:3.0:1790895496.987030:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+29:11628:x1877889741062144:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1790895496.987162:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987187:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987205:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987471:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987481:0:5832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987489:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987496:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895496.987514:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987525:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987543:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:3.0:1790895496.987546:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1790895496.987552:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895496.987558:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9670 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895496.987776:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+30:11628:x1877889741062144:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 748us (4307us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1790895496.987784:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 234 00000040:00080000:2.0:1790895496.988170:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895496.988177:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895496.988773:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1790895496.988785:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790895496.993406:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741062272 00000100:00100000:0.0:1790895496.993431:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741062272 00000100:00100000:0.0:1790895496.993564:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:0.0:1790895496.993577:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306504050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+30:2361:x1877889741062272:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895496.993599:0:11170:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895496.993656:0:11170:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e600/0x7911a98710cf9662 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc304f expref: 30 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895496.993684:0:11170:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895496.993690:0:11170:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895496.993782:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306504050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+29:2361:x1877889741062272:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 207us (10210us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895496.993789:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:0.0:1790895496.994487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895496.994561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741062528 00000100:00100000:2.0:1790895496.994569:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741062528 00000100:00100000:2.0:1790895496.994618:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 64 00000100:00100000:2.0:1790895496.994627:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+29:11628:x1877889741062528:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1790895496.994983:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+30:11628:x1877889741062528:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 355us (498us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1790895496.994992:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 64 00000040:00080000:3.0:1790895497.010150:0:12567:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1790895497.010166:0:12567:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790895497.010227:0:12567:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1790895497.010239:0:12567:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1790895497.253205:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895497.253264:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741062784 00000100:00100000:0.0:1790895497.253277:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741062784 00000100:00100000:0.0:1790895497.253357:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 235 00000100:00100000:0.0:1790895497.253369:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+30:11641:x1877889741062784:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:0.0:1790895497.253401:0:7639:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895497.253429:0:7639:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9677 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3056 expref: -99 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895497.253578:0:7639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf967e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895497.253596:0:7639:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf967e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895497.253615:0:7639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf967e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7639 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895497.253629:0:7639:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1790895497.253798:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c200/0x7911a98710cf9677 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3056 expref: 33 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895497.253839:0:7639:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf967e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3056 expref: 32 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895497.253849:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:0.0:1790895497.253852:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1790895497.253883:0:7639:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895497.253959:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+32:11641:x1877889741062784:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 592us (770us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1790895497.253966:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 235 00000100:00080000:0.0:1790895497.256121:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895497.262184:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895497.263433:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741062912 00000100:00100000:2.0:1790895497.263451:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741062912 00000100:00100000:2.0:1790895497.263544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 236 00000100:00100000:2.0:1790895497.263557:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+32:11641:x1877889741062912:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:2.0:1790895497.263658:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263680:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263696:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263732:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263739:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263755:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263762:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895497.263768:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263777:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263794:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:2.0:1790895497.263798:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790895497.263805:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.263813:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f200/0x7911a98710cf968c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5831 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895497.263958:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+32:11641:x1877889741062912:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 403us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895497.263966:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 236 00000100:00100000:0.0:1790895497.414075:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895497.414217:0:12529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063040 00000100:00100000:2.0:1790895497.414231:0:12529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063040 00000100:00100000:2.0:1790895497.414333:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 70 00000100:00100000:2.0:1790895497.414351:0:12529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741063040:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:2.0:1790895497.414380:0:12529:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895497.414410:0:12529:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9693 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc305d expref: -99 pid: 12529 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895497.414471:0:12529:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6abee586, atime: 0x6abee586, ctime: 0x6abee586, blocks: 0xb 00010000:00010000:2.0:1790895497.414512:0:12529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1790895497.414518:0:12529:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895497.414530:0:12529:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc305d expref: 8 pid: 12529 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.414554:0:12529:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9693 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc305d expref: 8 pid: 12529 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895497.414570:0:12529:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f200, rc 0) 00000100:00100000:2.0:1790895497.414657:0:12529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2361:x1877889741063040:12345-192.168.201.54@tcp:101:cat.0 Request processed in 312us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895497.414665:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 70 00000100:00080000:0.0:1790895497.415373:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895497.419931:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895497.420083:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063168 00000100:00100000:0.0:1790895497.420098:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063168 00002000:00100000:0.0:1790895497.423272:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cf340632d80 x1877889741063168/t0(0) o3->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:23/0 lens 488/0 e 0 to 0 dl 1790895508 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895497.423291:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf340632d80 with x1877889741063168 ext(0->4095) 00002000:00010000:0.0:1790895497.423301:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf340632d80 00000100:00100000:0.0:1790895497.423360:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:0.0:1790895497.423381:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2364:x1877889741063168:12345-192.168.201.54@tcp:3:cat.0 00000100:00100000:0.0:1790895497.423698:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340632d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2364:x1877889741063168:12345-192.168.201.54@tcp:3:cat.0 Request processed in 327us (3782us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1790895497.423707:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00002000:00100000:0.0:1790895497.423715:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff8cf340632d80 x1877889741063168/t0(0) o3->5979f259-4636-4129-bc0f-4cbabdd61a69@192.168.201.54@tcp:23/0 lens 488/4536 e 0 to 0 dl 1790895508 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1790895497.423747:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8cf340632d80 with x1877889741063168 ext(0->4095) 00002000:00010000:0.0:1790895497.423751:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8cf340632d80 00010000:00010000:0.0:1790895497.944118:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895498.121851:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895498.122426:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895498.122433:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063296 00000100:00100000:1.0:1790895498.122444:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063296 00000100:00100000:2.0:1790895498.122466:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895498.122515:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063552 00000100:00100000:3.0:1790895498.122519:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063552 00000100:00100000:2.0:1790895498.122519:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895498.122551:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895498.122571:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063680 00000100:00100000:2.0:1790895498.122571:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063808 00000100:00100000:3.0:1790895498.122575:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063680 00000100:00100000:2.0:1790895498.122575:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063808 00000100:00100000:2.0:1790895498.122621:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063424 00000100:00100000:2.0:1790895498.122624:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063424 00000100:00100000:1.0:1790895498.122625:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 294 00000100:00100000:1.0:1790895498.122634:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889741063296:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895498.122642:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 150 00000100:00100000:2.0:1790895498.122648:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889741063808:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895498.122708:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340630380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2363:x1877889741063808:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 58us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895498.122708:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303118450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889741063296:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 73us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895498.122715:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 294 00000100:00100000:2.0:1790895498.122719:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 150 00000100:00100000:2.0:1790895498.122889:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 151 00000100:00100000:3.0:1790895498.122902:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 77 00000100:00100000:2.0:1790895498.122908:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+32:2363:x1877889741063424:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895498.122909:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2363:x1877889741063552:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895498.122967:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:1.0:1790895498.122985:0:12529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3101d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889741063680:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895498.123070:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340631500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+8:2363:x1877889741063552:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 161us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895498.123076:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 77 00000100:00080000:3.0:1790895498.123111:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895498.123115:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895498.126407:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+32:2363:x1877889741063424:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 3492us (3867us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895498.126407:0:12529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3101d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2363:x1877889741063680:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 3428us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895498.126424:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 151 00000100:00100000:1.0:1790895498.126424:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 78 00000001:00080000:2.0:1790895498.800343:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1790895498.800368:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:2.0:1790895498.800380:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1790895498.968724:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1790895499.736161:0:6875:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 372703298605ns, next at 373703295049ns, rc = 0 00000100:00100000:2.0:1790895499.736212:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758867968:0@lo:400:kworker.0 00000100:00100000:1.0:1790895499.736212:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758868096:0@lo:400:kworker.0 00000100:00100000:3.0:1790895499.736276:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf308d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758867840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895499.741055:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895499.741166:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758868480:0@lo:400:kworker.0 00000100:00100000:2.0:1790895499.741208:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895499.741285:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868480 00000100:00100000:2.0:1790895499.741298:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868480 00000100:00100000:2.0:1790895499.741371:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1790895499.741384:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895499.741450:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758868480:12345-0@lo:400:kworker.0 Request processed in 71us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895499.741471:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:2.0:1790895499.741500:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895499.741541:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758868480:0@lo:400:kworker.0 00000100:00100000:2.0:1790895499.742299:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758867968 00000100:00100000:2.0:1790895499.742310:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758867968 00000100:00100000:2.0:1790895499.742355:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790895499.742364:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758867968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895499.742428:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758867968:12345-0@lo:400:kworker.0 Request processed in 66us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895499.742436:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1790895499.742499:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758867968:0@lo:400:kworker.0 00000100:00100000:3.0:1790895499.746278:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895499.746353:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758868352:0@lo:400:kworker.0 00000100:00100000:3.0:1790895499.746401:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895499.746444:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868352 00000100:00100000:3.0:1790895499.746467:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868352 00000100:00100000:3.0:1790895499.746552:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790895499.746583:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758868352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895499.746651:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758868352:12345-0@lo:400:kworker.0 Request processed in 71us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895499.746659:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1790895499.746731:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758868352:0@lo:400:kworker.0 00000100:00100000:1.0:1790895499.746849:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758867840 00000100:00100000:1.0:1790895499.746885:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758867840 00000100:00100000:1.0:1790895499.746921:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790895499.746928:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758867840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790895499.746963:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895499.747006:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758867840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895499.747012:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790895499.747261:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758868224:0@lo:400:kworker.0 00000100:00100000:1.0:1790895499.747294:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895499.747344:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790895499.747406:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895499.747412:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868224 00000100:00100000:3.0:1790895499.747416:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868224 00000100:00080000:2.0:1790895499.747435:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895499.747465:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868096 00000100:00100000:3.0:1790895499.747468:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868096 00000100:00100000:2.0:1790895499.747483:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1790895499.747489:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1790895499.747494:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758868096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895499.747497:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758868224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895499.747540:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1877889758868224:12345-0@lo:400:kworker.0 Request processed in 49us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895499.747546:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1790895499.747583:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf308d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758867840:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895499.749801:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3309:1877889758868224:0@lo:400:kworker.0 00000100:00100000:3.0:1790895499.761790:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758868096:12345-0@lo:400:kworker.0 Request processed in 14277us (14427us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895499.761812:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1790895499.770364:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758868096:0@lo:400:kworker.0 00000100:00100000:1.0:1790895499.770386:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758868608:0@lo:400:kworker.0 00000100:00100000:1.0:1790895499.770474:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895499.773090:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868608 00000100:00100000:3.0:1790895499.773111:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868608 00000100:00100000:3.0:1790895499.773196:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1790895499.773209:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758868608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895499.773329:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758868608:12345-0@lo:400:kworker.0 Request processed in 123us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895499.773337:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:3.0:1790895499.773366:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895499.774681:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1790895499.774705:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1790895499.774736:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf336e34380, transno 4294967310 00000100:00100000:1.0:1790895499.774768:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758868608:0@lo:400:kworker.0 00010000:00010000:1.0:1790895499.994080:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895500.257315:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895500.257341:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758868736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1790895500.257410:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895500.257484:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868736 00000100:00100000:1.0:1790895500.257491:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868736 00000100:00100000:1.0:1790895500.257550:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790895500.257560:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758868736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790895500.257593:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895500.257639:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758868736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895500.257645:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790895500.258218:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758868736:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1790895500.837274:0:12425:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1790895500.837295:0:12425:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8cf3059629c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1790895500.837300:0:12425:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f9c5800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8cf305962840 00000020:00080000:2.0:1790895500.837303:0:12425:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8cf33f9c5200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8cf33a823800 00000020:00080000:2.0:1790895500.837320:0:12425:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000004:00080000:2.0:1790895500.837328:0:12425:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 11 committed 00000020:00080000:2.0:1790895500.837434:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1790895500.837654:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1790895500.837752:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf308d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758868864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1790895500.837847:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895500.837982:0:12529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868864 00000100:00100000:2.0:1790895500.837989:0:12529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868864 00000100:00100000:2.0:1790895500.838034:0:12529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790895500.838043:0:12529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758868864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1790895500.838220:0:12529:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1790895500.838224:0:12529:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1790895494 -> 1790895494 00002000:00010000:2.0:1790895500.838227:0:12529:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1790895494 -> 1790895494 00002000:00010000:2.0:1790895500.838229:0:12529:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1790895494 -> 1790895494 00002000:00010000:2.0:1790895500.838231:0:12529:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1790895500.838270:0:12529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3310:x1877889758868864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 228us (423us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1790895500.838278:0:12529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000004:00080000:2.0:1790895500.838332:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf308d5ca80/2, rc 0, transno 4294967324 00000100:00100000:2.0:1790895500.838338:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf308d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758868864:0@lo:2:osp-syn-0-0.0 00000001:00080000:1.0:1790895500.856656:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:1.0:1790895500.856674:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1790895500.856682:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00010000:00010000:0.0:1790895501.017852:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895502.049773:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895502.468060:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895502.468098:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741063936 00000100:00100000:2.0:1790895502.468109:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741063936 00000100:00100000:2.0:1790895502.468173:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 237 00000100:00100000:2.0:1790895502.468184:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11294:x1877889741063936:12345-192.168.201.54@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1790895502.468300:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11294:x1877889741063936:12345-192.168.201.54@tcp:60:lhsmtool_posix.0 Request processed in 106us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895502.468308:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 237 00000100:00080000:2.0:1790895502.468330:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895502.470904:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895502.471020:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741064192 00000100:00100000:3.0:1790895502.471030:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741064192 00000100:00100000:3.0:1790895502.471082:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 65 00000100:00100000:3.0:1790895502.471092:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:11294:x1877889741064192:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1790895502.471474:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:11294:x1877889741064192:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 383us (578us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1790895502.471494:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 65 00010000:00010000:1.0:1790895503.066204:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895503.128239:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895503.128261:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895503.128576:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1790895503.128583:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1790895503.245109:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895503.245156:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895503.245190:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895503.245227:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895503.245257:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895503.245287:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741064832 00000100:00100000:2.0:1790895503.245298:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741064832 00000100:00100000:2.0:1790895503.245362:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741064448 00000100:00100000:2.0:1790895503.245365:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741064448 00000100:00100000:2.0:1790895503.245387:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 155 00000100:00100000:2.0:1790895503.245432:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889741064832:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895503.245513:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:2362:x1877889741064832:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 117us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895503.245521:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 155 00000100:00100000:2.0:1790895503.245540:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 156 00000100:00100000:2.0:1790895503.245548:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:2362:x1877889741064448:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895503.245578:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:2362:x1877889741064448:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895503.245583:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 156 00000100:00080000:2.0:1790895503.245601:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895503.246201:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741064320 00000100:00100000:1.0:1790895503.246208:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741064320 00000100:00100000:1.0:1790895503.246246:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 296 00000100:00100000:1.0:1790895503.246254:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2362:x1877889741064320:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895503.246293:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cfab9d81-c206-47b6-8949-7d56204af956+13:2362:x1877889741064320:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 40us (1194us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895503.246300:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 296 00000100:00100000:3.0:1790895503.246475:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741064576 00000100:00100000:3.0:1790895503.246480:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741064576 00000100:00100000:3.0:1790895503.246560:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741064704 00000100:00100000:3.0:1790895503.246563:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741064704 00000100:00100000:3.0:1790895503.246588:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 81 00000100:00100000:3.0:1790895503.246595:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741064576:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895503.246629:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2362:x1877889741064576:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 35us (1472us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895503.246635:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 81 00000100:00100000:3.0:1790895503.246648:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 82 00000100:00100000:3.0:1790895503.246655:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889741064704:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895503.246694:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2362:x1877889741064704:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 40us (1436us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895503.246700:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 82 00000100:00080000:1.0:1790895503.250409:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1790895503.250422:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1790895504.089003:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1790895504.115684:0:12769:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 18:58:23 (1790895503) 00000100:00100000:2.0:1790895504.856514:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895504.856538:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf308d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758868992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895504.856615:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895504.856772:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758868992 00000100:00100000:1.0:1790895504.856781:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758868992 00000100:00100000:1.0:1790895504.856851:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790895504.856902:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758868992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790895504.856943:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895504.856995:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1877889758868992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895504.857002:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790895504.857108:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758869120:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857146:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895504.857171:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758869632:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857195:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895504.857217:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895504.857222:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758869248:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857276:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895504.857309:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758869120 00000100:00100000:1.0:1790895504.857313:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758869120 00000100:00100000:1.0:1790895504.857341:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790895504.857347:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758869120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857395:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758869120:12345-0@lo:400:kworker.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895504.857402:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1790895504.857431:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758869632 00000100:00100000:1.0:1790895504.857435:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758869632 00000100:00100000:1.0:1790895504.857465:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790895504.857472:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758869632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857502:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758869632:12345-0@lo:400:kworker.0 Request processed in 31us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895504.857508:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1790895504.857524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758869248 00000100:00100000:1.0:1790895504.857527:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758869248 00000100:00100000:1.0:1790895504.857549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790895504.857555:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758869248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857585:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758869248:12345-0@lo:400:kworker.0 Request processed in 30us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895504.857601:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1790895504.857630:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758869504:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857656:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895504.857679:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790895504.857686:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758869376:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857708:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895504.857732:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758869504 00000100:00100000:1.0:1790895504.857736:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758869504 00000100:00100000:1.0:1790895504.857760:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758869376 00000100:00100000:1.0:1790895504.857764:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758869376 00000100:00100000:1.0:1790895504.857785:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790895504.857792:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758869504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857825:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758869504:12345-0@lo:400:kworker.0 Request processed in 33us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895504.857832:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1790895504.857845:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790895504.857851:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758869376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857900:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758869376:12345-0@lo:400:kworker.0 Request processed in 50us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895504.857906:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1790895504.857947:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758869376:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857959:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758869504:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.857985:0:3310:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:1.0:1790895504.857990:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf3369e2d80, transno 4294967321 00000004:00080000:1.0:1790895504.858001:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:1.0:1790895504.858027:0:3310:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff8cf308d5ca80 x1877889758868864/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1790895516 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895504.858042:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf308d5ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758868992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895504.858459:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758869248:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.858469:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758869120:0@lo:400:kworker.0 00000100:00100000:1.0:1790895504.858479:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758869632:0@lo:400:kworker.0 00000100:00080000:2.0:1790895504.860333:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1790895504.860350:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895504.860353:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1790895505.113117:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895505.368138:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758869760:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895505.368230:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895505.368482:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758869760 00000100:00100000:1.0:1790895505.368492:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758869760 00000100:00100000:1.0:1790895505.368552:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790895505.368562:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758869760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790895505.368607:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895505.368659:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758869760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895505.368667:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790895505.368714:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758869760:0@lo:13:osp-pre-1-0.0 00000020:00080000:3.0:1790895505.942242:0:12424:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1790895505.942266:0:12424:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1790895505.943890:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1790895505.943904:0:5865:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1790895505.980938:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:2.0:1790895506.138058:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895506.584258:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895506.584725:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741064960 00000100:00100000:1.0:1790895506.584736:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741064960 00000100:00100000:1.0:1790895506.584854:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 238 00000100:00100000:1.0:1790895506.584897:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+5:12306:x1877889741064960:12345-192.168.201.54@tcp:101:lsof.0 00010000:00010000:1.0:1790895506.584917:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895506.584973:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf969a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3064 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790895506.585101:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1790895506.585607:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf96a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895506.585634:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf96a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895506.585646:0:5832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf96a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1790895506.585681:0:5832:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1790895506.585685:0:5832:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1790895506.585846:0:5832:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf96a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5832 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895506.585908:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf969a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3064 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895506.586032:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf96a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3064 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895506.586042:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:0.0:1790895506.586060:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1790895506.586064:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c800, rc 0) 00000100:00100000:0.0:1790895506.586130:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:12306:x1877889741064960:12345-192.168.201.54@tcp:101:lsof.0 Request processed in 1235us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895506.586138:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 238 00010000:00010000:1.0:1790895507.160178:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895508.184030:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895508.370680:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.370723:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.370756:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.370781:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.370808:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.370833:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741065600 00000100:00100000:2.0:1790895508.370843:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741065600 00000100:00100000:2.0:1790895508.370920:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741065216 00000100:00100000:2.0:1790895508.370923:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741065216 00000100:00100000:2.0:1790895508.370945:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 160 00000100:00100000:2.0:1790895508.370954:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:2361:x1877889741065600:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895508.371025:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:2361:x1877889741065600:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 73us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895508.371032:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 160 00000100:00100000:2.0:1790895508.371050:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 161 00000100:00100000:2.0:1790895508.371056:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+19:2361:x1877889741065216:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:2.0:1790895508.371081:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:5979f259-4636-4129-bc0f-4cbabdd61a69+19:2361:x1877889741065216:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 25us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895508.371103:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 161 00000100:00080000:2.0:1790895508.371122:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895508.371522:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741065344 00000100:00100000:0.0:1790895508.371527:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741065344 00000100:00100000:0.0:1790895508.371565:0:8701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741065472 00000100:00100000:0.0:1790895508.371567:0:8701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741065472 00000100:00100000:0.0:1790895508.371587:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:0.0:1790895508.371594:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741065344:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895508.371633:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2361:x1877889741065344:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 39us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895508.371640:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:0.0:1790895508.371651:0:8701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 85 00000100:00100000:0.0:1790895508.371656:0:8701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889741065472:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895508.371675:0:8701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2361:x1877889741065472:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 19us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895508.371692:0:8701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 85 00000100:00100000:3.0:1790895508.372391:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741065088 00000100:00100000:3.0:1790895508.372398:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741065088 00000100:00100000:3.0:1790895508.372434:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 298 00000100:00100000:3.0:1790895508.372444:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741065088:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895508.372482:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cfab9d81-c206-47b6-8949-7d56204af956+13:2361:x1877889741065088:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 41us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895508.372502:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 298 00000100:00080000:2.0:1790895508.373971:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1790895508.373979:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895508.763994:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895508.764084:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741065856 00000100:00100000:3.0:1790895508.764095:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741065856 00000100:00100000:3.0:1790895508.764160:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00100000:3.0:1790895508.764174:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+19:12307:x1877889741065856:12345-192.168.201.54@tcp:35:umount.0 00000100:00100000:3.0:1790895508.764579:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:12307:x1877889741065856:12345-192.168.201.54@tcp:35:umount.0 Request processed in 408us (593us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1790895508.764587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 66 00000100:00100000:3.0:1790895508.766696:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.766796:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741066112 00000100:00100000:2.0:1790895508.766806:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741066112 00000100:00100000:2.0:1790895508.766881:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 67 00000100:00100000:2.0:1790895508.766891:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+20:12307:x1877889741066112:12345-192.168.201.54@tcp:35:umount.0 00000100:00100000:2.0:1790895508.767250:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+21:12307:x1877889741066112:12345-192.168.201.54@tcp:35:umount.0 Request processed in 360us (561us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1790895508.767257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 67 00000100:00100000:0.0:1790895508.772245:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.772921:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741066368 00000100:00100000:2.0:1790895508.772933:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741066368 00000100:00100000:2.0:1790895508.772998:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:2.0:1790895508.773009:0:5835:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310b67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+21:12307:x1877889741066368:12345-192.168.201.54@tcp:35:umount.0 00000100:00100000:2.0:1790895508.773249:0:5835:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310b67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+22:12307:x1877889741066368:12345-192.168.201.54@tcp:35:umount.0 Request processed in 241us (1012us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1790895508.773257:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 68 00000100:00100000:3.0:1790895508.775254:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895508.775732:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741066624 00000100:00100000:2.0:1790895508.775741:0:5835:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741066624 00000100:00100000:0.0:1790895508.775887:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:0.0:1790895508.775900:0:5834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+22:12307:x1877889741066624:12345-192.168.201.54@tcp:35:umount.0 00000100:00100000:0.0:1790895508.776267:0:5834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+23:12307:x1877889741066624:12345-192.168.201.54@tcp:35:umount.0 Request processed in 369us (1019us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1790895508.776291:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 69 00000100:00100000:3.0:1790895508.780489:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895508.780534:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895508.780569:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895508.780666:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741067008 00000100:00100000:1.0:1790895508.780675:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741067008 00000100:00100000:1.0:1790895508.780738:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741066880 00000100:00100000:1.0:1790895508.780742:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741066880 00000100:00100000:1.0:1790895508.780756:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741067136 00000100:00100000:1.0:1790895508.780758:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741067136 00000100:00100000:1.0:1790895508.780775:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:1.0:1790895508.780785:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfab9d81-c206-47b6-8949-7d56204af956+15:2363:x1877889741067008:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895508.780811:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895508.780832:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf300030800/0x7911a98710cf868d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bbe expref: 15 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.780851:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895508.780933:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfab9d81-c206-47b6-8949-7d56204af956+14:2363:x1877889741067008:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 150us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895508.780941:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:1.0:1790895508.780957:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:1.0:1790895508.780963:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfab9d81-c206-47b6-8949-7d56204af956+13:2363:x1877889741066880:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895508.780971:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895508.780980:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7c000/0x7911a98710cf86c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bf6 expref: 13 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.780988:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895508.781006:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfab9d81-c206-47b6-8949-7d56204af956+12:2363:x1877889741066880:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 44us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895508.781012:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:1.0:1790895508.781024:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:1.0:1790895508.781030:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfab9d81-c206-47b6-8949-7d56204af956+11:2363:x1877889741067136:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895508.781052:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895508.781061:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf8911 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cc1 expref: 11 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.781069:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895508.781089:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cfab9d81-c206-47b6-8949-7d56204af956+10:2363:x1877889741067136:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 59us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895508.781229:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:3.0:1790895508.781946:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895508.781999:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741066752 00000100:00100000:0.0:1790895508.782005:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741066752 00000100:00100000:0.0:1790895508.782050:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 72 00000100:00100000:0.0:1790895508.782058:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+5:2360:x1877889741066752:12345-192.168.201.54@tcp:9:umount.0 00000020:00000080:0.0:1790895508.782082:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf89ff 00000100:00080000:0.0:1790895508.782091:0:6688:0:(import.c:65:import_set_state_nolock()) ffff8cf302ca5000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790895508.782137:0:6688:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790895508.782397:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5979f259-4636-4129-bc0f-4cbabdd61a69+2:2360:x1877889741066752:12345-192.168.201.54@tcp:9:umount.0 Request processed in 338us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895508.782403:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 72 00010000:00010000:0.0:1790895508.782422:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895508.789163:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895508.789275:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741067520 00000100:00100000:0.0:1790895508.789285:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741067520 00000100:00100000:0.0:1790895508.789389:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00100000:0.0:1790895508.789400:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+7:2360:x1877889741067520:12345-192.168.201.54@tcp:9:umount.0 00000020:00000080:0.0:1790895508.789432:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8c67 00000020:00010000:0.0:1790895508.789440:0:6691:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cf33f9e5800: total 0 00000100:00080000:0.0:1790895508.789445:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf33f9e6000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790895508.789491:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:1.0:1790895508.789886:0:6704:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cf33f9e5800: total 0 00010000:00010000:1.0:1790895508.789923:0:6704:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cf33f9e5800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1790895508.789976:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9693 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc305d expref: 7 pid: 12529 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.790012:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040822c1e/0x7911a98710cf9003 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e96 expref: 6 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.790028:0:6704:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cf33f9e5800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1790895508.790041:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895508.790043:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895508.790045:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895508.790163:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5979f259-4636-4129-bc0f-4cbabdd61a69+2:2360:x1877889741067520:12345-192.168.201.54@tcp:9:umount.0 Request processed in 763us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895508.790171:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 73 00000100:00100000:1.0:1790895508.799129:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895508.799196:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741068544 00000100:00100000:0.0:1790895508.799207:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741068544 00000100:00100000:0.0:1790895508.799312:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 239 00000100:00100000:0.0:1790895508.799337:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+23:2360:x1877889741068544:12345-192.168.201.54@tcp:39:umount.0 00000020:00000080:0.0:1790895508.799498:0:5832:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf869b 00000020:00010000:0.0:1790895508.799515:0:5832:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cf3371ff800: total 0 00000100:00080000:0.0:1790895508.799521:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8cf3371f9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790895508.799589:0:5832:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1790895508.800000:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5979f259-4636-4129-bc0f-4cbabdd61a69+22:2360:x1877889741068544:12345-192.168.201.54@tcp:39:umount.0 Request processed in 665us (881us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1790895508.800008:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 239 00000020:00010000:1.0:1790895508.800062:0:5820:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cf3371ff800: total 0 00010000:00010000:1.0:1790895508.800104:0:5820:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cf3371ff800, canceled 0 locks, left on hash table 14. 00010000:00010000:1.0:1790895508.800136:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:1.0:1790895508.800140:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790895508.800149:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf8fb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e81 expref: 21 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800187:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:1.0:1790895508.800190:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790895508.800195:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e000/0x7911a98710cf8fee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e8f expref: 20 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800209:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:1.0:1790895508.800211:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790895508.800216:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c200/0x7911a98710cf9057 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eab expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800229:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895508.800231:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790895508.800235:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84f800/0x7911a98710cf8cc2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2dbd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800246:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:1.0:1790895508.800248:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1790895508.800251:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7da00/0x7911a98710cf8965 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ccf expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800301:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895508.800316:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895508.800322:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167d000/0x7911a98710cf9654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3048 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800336:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895508.800338:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1790895508.800349:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7cc00/0x7911a98710cf967e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3056 expref: 15 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800363:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:1.0:1790895508.800505:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790895508.800511:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84e200/0x7911a98710cf8ee4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e49 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800527:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:1.0:1790895508.800530:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895508.800533:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f84fa00/0x7911a98710cf8fe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2e88 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800548:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8cf314095600) 00010000:00010000:1.0:1790895508.800550:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790895508.800554:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf89d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2ceb expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800567:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8cf3183e2f00) 00010000:00010000:1.0:1790895508.800569:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790895508.800572:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91cc00/0x7911a98710cf9574 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3010 expref: 11 pid: 7639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800585:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895508.800588:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1790895508.800591:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ca00/0x7911a98710cf9073 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2eb2 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800602:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf314095a00) 00010000:00010000:1.0:1790895508.800610:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895508.800615:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d200/0x7911a98710cf8981 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cd6 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800630:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8cf310cb5400) 00010000:00010000:1.0:1790895508.800632:0:5820:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1790895508.800636:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c600/0x7911a98710cf9352 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2f84 expref: 8 pid: 12417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895508.800649:0:5820:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cf3371ff800, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1790895508.800663:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895508.800665:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895508.800667:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790895508.999019:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:0.0:1790895508.999030:0:7641:0:(genops.c:885:class_export_put()) final put ffff8cf302ca2000/5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:1.0:1790895508.999503:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf302ca2000/5979f259-4636-4129-bc0f-4cbabdd61a69 for lustre-OST0001 00000020:00000080:1.0:1790895508.999623:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf302ca5000 for lustre-OST0001 00010000:00010000:0.0:1790895509.209156:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895509.976126:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758870144:0@lo:400:kworker.0 00000100:00100000:1.0:1790895509.976205:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895509.976296:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870144 00000100:00100000:1.0:1790895509.976304:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870144 00000100:00100000:0.0:1790895509.976485:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758870016:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.976517:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895509.976538:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790895509.976544:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758869888:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.976573:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1790895509.976619:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895509.976658:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790895509.976665:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758870400:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.976689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895509.976729:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758870528:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.976756:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895509.976807:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758870272:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.976835:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895509.976890:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758869888 00000100:00100000:0.0:1790895509.976895:0:5826:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758869888 00000100:00100000:0.0:1790895509.976946:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790895509.976956:0:5826:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758869888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977010:0:5826:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:221ad158-1cb7-4652-832e-1e3667184cca+19:3311:x1877889758869888:12345-0@lo:400:kworker.0 Request processed in 55us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895509.977029:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1790895509.977066:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870528 00000100:00100000:0.0:1790895509.977070:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870528 00000100:00100000:0.0:1790895509.977100:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870272 00000100:00100000:0.0:1790895509.977103:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870272 00000100:00100000:0.0:1790895509.977122:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790895509.977130:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758870528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977162:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758870528:12345-0@lo:400:kworker.0 Request processed in 33us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895509.977168:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1790895509.977179:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1790895509.977185:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758870272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977213:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758870272:12345-0@lo:400:kworker.0 Request processed in 29us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895509.977219:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1790895509.977232:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895509.977234:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790895509.977254:0:3309:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1790895509.977259:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8cf308d5ca80, transno 4294967324 00000100:00100000:0.0:1790895509.977271:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758870272:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977313:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758870528:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977322:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758869888:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977569:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870016 00000100:00100000:0.0:1790895509.977574:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870016 00000100:00100000:0.0:1790895509.977594:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870400 00000100:00100000:0.0:1790895509.977597:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870400 00000100:00100000:0.0:1790895509.977620:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790895509.977626:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758870016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977663:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758870016:12345-0@lo:400:kworker.0 Request processed in 37us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895509.977669:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1790895509.977682:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1790895509.977688:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758870400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977714:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758870400:12345-0@lo:400:kworker.0 Request processed in 27us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895509.977720:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00080000:0.0:1790895509.977738:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895509.977762:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758870400:0@lo:400:kworker.0 00000100:00100000:0.0:1790895509.977789:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758870016:0@lo:400:kworker.0 00000100:00100000:1.0:1790895509.978587:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790895509.978597:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3031f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758870144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895509.978640:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3031f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758870144:12345-0@lo:400:kworker.0 Request processed in 47us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895509.978658:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1790895509.978688:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758870144:0@lo:400:kworker.0 00000100:00100000:2.0:1790895509.979233:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1790895509.979245:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf308d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758870656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895509.979277:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895509.979317:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870656 00000100:00100000:2.0:1790895509.979322:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870656 00000100:00100000:2.0:1790895509.979374:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790895509.979382:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758870656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1790895509.979407:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895509.979442:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758870656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895509.979448:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790895509.979481:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf308d5fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758870656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790895510.232080:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895510.488351:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895510.488376:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758870784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895510.488447:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895510.491491:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870784 00000100:00100000:1.0:1790895510.491524:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870784 00000100:00100000:1.0:1790895510.491592:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790895510.491604:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758870784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1790895510.491648:0:6693:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895510.491735:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758870784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (3287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895510.491753:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1790895510.492078:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758870784:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1790895511.075189:0:5854:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000001:00080000:1.0:1790895511.075204:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1790895511.075221:0:5854:0:(genops.c:885:class_export_put()) final put ffff8cf3371ff800/5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:1.0:1790895511.075335:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3371ff800/5979f259-4636-4129-bc0f-4cbabdd61a69 for lustre-MDT0000 00000020:00000080:1.0:1790895511.075403:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf3371f9800 for lustre-MDT0000 00000001:00100000:0.0:1790895511.088913:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:0.0:1790895511.088922:0:6715:0:(genops.c:885:class_export_put()) final put ffff8cf33f9e5800/5979f259-4636-4129-bc0f-4cbabdd61a69 00000020:00000080:1.0:1790895511.089505:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33f9e5800/5979f259-4636-4129-bc0f-4cbabdd61a69 for lustre-OST0000 00000020:00000080:1.0:1790895511.089555:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf33f9e6000 for lustre-OST0000 00010000:00010000:1.0:1790895511.256623:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895511.265365:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895511.265423:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895511.265464:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895511.265619:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741068800 00000100:00100000:3.0:1790895511.265630:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741068800 00000100:00100000:3.0:1790895511.265693:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741068672 00000100:00100000:3.0:1790895511.265697:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741068672 00000100:00100000:3.0:1790895511.265711:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741068928 00000100:00100000:3.0:1790895511.265714:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741068928 00000100:00100000:3.0:1790895511.265741:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:3.0:1790895511.265761:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+12:2361:x1877889741068800:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895511.265796:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895511.265819:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f91d600/0x7911a98710cf8774 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c35 expref: 12 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895511.265839:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895511.265933:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+11:2361:x1877889741068800:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 182us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895511.265940:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:3.0:1790895511.265956:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:3.0:1790895511.265961:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+10:2362:x1877889741068672:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895511.265968:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895511.265977:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf300031200/0x7911a98710cf876d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2c0b expref: 10 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895511.265987:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895511.266004:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+9:2362:x1877889741068672:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 43us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895511.266011:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:3.0:1790895511.266022:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:3.0:1790895511.266028:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+8:2361:x1877889741068928:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895511.266035:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895511.266043:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf3029cb600/0x7911a98710cf890a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2cba expref: 8 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895511.266052:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895511.266066:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cfab9d81-c206-47b6-8949-7d56204af956+7:2361:x1877889741068928:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 39us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895511.266079:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:3.0:1790895511.269311:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895511.273225:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741069184 00000100:00100000:0.0:1790895511.273241:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741069184 00000100:00100000:0.0:1790895511.273400:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 240 00000100:00100000:0.0:1790895511.273421:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+6:2360:x1877889741069184:12345-192.168.201.54@tcp:39:umount.0 00000020:00000080:0.0:1790895511.273463:0:5832:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8782 00000020:00010000:0.0:1790895511.273472:0:5832:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cf30643e800: total 0 00000100:00080000:0.0:1790895511.273478:0:5832:0:(import.c:65:import_set_state_nolock()) ffff8cf30643b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790895511.273521:0:5832:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1790895511.274401:0:5819:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cf30643e800: total 0 00010000:00010000:3.0:1790895511.274415:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895511.274457:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cf30643e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1790895511.274492:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2000) 00010000:00010000:3.0:1790895511.274496:0:5819:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895511.274507:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c800/0x7911a98710cf96a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3064 expref: 5 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895511.274531:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cf30643e800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1790895511.274540:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895511.274541:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895511.274543:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895511.277109:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6eb9aba8-c466-4e48-9c75-9d75f799e495+3:2360:x1877889741069184:12345-192.168.201.54@tcp:39:umount.0 Request processed in 3689us (7795us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1790895511.277122:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 240 00000100:00080000:2.0:1790895511.280250:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895511.297681:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895511.301195:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741069440 00000100:00100000:1.0:1790895511.301215:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741069440 00000100:00100000:1.0:1790895511.301301:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 300 00000100:00100000:1.0:1790895511.301313:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+7:2360:x1877889741069440:12345-192.168.201.54@tcp:251:umount.0 00000020:00000080:1.0:1790895511.301360:0:5825:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8678 00000020:00010000:1.0:1790895511.301368:0:5825:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cf202b2e000: total 0 00000100:00080000:1.0:1790895511.301373:0:5825:0:(import.c:65:import_set_state_nolock()) ffff8cf202b2d000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1790895511.301463:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf30311a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cfab9d81-c206-47b6-8949-7d56204af956+3:2360:x1877889741069440:12345-192.168.201.54@tcp:251:umount.0 Request processed in 152us (3791us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895511.301471:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 300 00000020:00010000:2.0:1790895511.303302:0:6704:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cf202b2e000: total 0 00010000:00010000:2.0:1790895511.303378:0:6704:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cf202b2e000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1790895511.303418:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf300030600/0x7911a98710cf86cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc2bfd expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895511.303436:0:6704:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cf202b2e000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1790895511.303448:0:6704:0:(genops.c:885:class_export_put()) final put ffff8cf202b2e000/cfab9d81-c206-47b6-8949-7d56204af956 00010000:00010000:2.0:1790895511.303468:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895511.303471:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895511.303473:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790895511.304165:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf202b2e000/cfab9d81-c206-47b6-8949-7d56204af956 for MGS 00000020:00000080:0.0:1790895511.304224:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf202b2d000 for MGS 00010000:00010000:1.0:1790895512.302962:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895513.305234:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895513.375179:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1790895513.375188:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895513.375602:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1790895513.375610:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000020:01000004:0.0:1790895513.558822:0:12970:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790895513.582918:0:12970:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1790895513.582980:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.582997:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.583006:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.583014:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.583030:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790895513.583035:0:12970:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790895513.583064:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790895513.583070:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790895513.583076:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790895513.583103:0:12970:0:(import.c:65:import_set_state_nolock()) ffff8cf33909c800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1790895513.583302:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895513.583310:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.583330:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf300030000 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895513.583334:0:6704:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.583342:0:6704:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895513.583349:0:6704:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895513.583354:0:6704:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790895513.583357:0:6704:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1790895513.583359:0:6704:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1790895513.583393:0:6704:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.583400:0:6704:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895513.583431:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.583438:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf300030000/0x7911a98710cf870b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8712 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.583452:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895513.583454:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895513.583455:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895513.583591:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758870912:0@lo:39:umount.0 00000100:00100000:3.0:1790895513.583663:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895513.583833:0:12417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758870912 00000100:00100000:2.0:1790895513.583841:0:12417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758870912 00000100:00100000:2.0:1790895513.583921:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1790895513.583930:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877889758870912:12345-0@lo:39:umount.0 00000020:00000080:2.0:1790895513.583965:0:12417:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8487 00000100:00080000:2.0:1790895513.583974:0:12417:0:(import.c:65:import_set_state_nolock()) ffff8cf338c5f000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1790895513.584031:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+1:3307:x1877889758870912:12345-0@lo:39:umount.0 Request processed in 102us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895513.584038:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:2.0:1790895513.584047:0:12417:0:(genops.c:885:class_export_put()) final put ffff8cf338c58800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1790895513.584075:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf338c58800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1790895513.584120:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf338c5f000 for lustre-MDT0000 00000100:00080000:3.0:1790895513.584204:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf33909c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1790895513.584230:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758870912:0@lo:39:umount.0 00000100:00080000:2.0:1790895513.584275:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790895513.584278:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1790895513.584282:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790895513.585383:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.585400:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.585406:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.585413:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.585445:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895513.585451:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895513.585647:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758871040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790895513.585707:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790895513.585779:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895513.585785:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.585794:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf301522a00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:1.0:1790895513.585797:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.585805:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790895513.585823:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895513.585829:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1790895513.585831:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1790895513.586044:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.586051:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790895513.586066:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.586073:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf301522a00/0x7911a98710cf8719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8720 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.586085:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895513.586087:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895513.586089:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895513.586603:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871040 00000100:00100000:1.0:1790895513.586612:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871040 00000100:00100000:1.0:1790895513.586665:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790895513.586673:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306507850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+19:3310:x1877889758871040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895513.586687:0:5816:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895513.586703:0:5816:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f91c000/0x7911a98710cf8712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf870b expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.586716:0:5816:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895513.586760:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306507850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:221ad158-1cb7-4652-832e-1e3667184cca+18:3310:x1877889758871040:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895513.586778:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1790895513.587010:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758871040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790895513.587027:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1790895513.587034:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758871168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790895513.587061:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895513.587085:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871168 00000100:00100000:1.0:1790895513.587089:0:5818:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871168 00000100:00100000:1.0:1790895513.587114:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790895513.587121:0:5818:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf308d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+18:3310:x1877889758871168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895513.587128:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895513.587137:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f91de00/0x7911a98710cf8720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf8719 expref: 18 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.587146:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895513.587172:0:5818:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf308d5fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:221ad158-1cb7-4652-832e-1e3667184cca+17:3310:x1877889758871168:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895513.587178:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790895513.587203:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:221ad158-1cb7-4652-832e-1e3667184cca:3310:1877889758871168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1790895513.587534:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587561:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587567:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587582:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895513.587590:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587597:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587602:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587607:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587618:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1790895513.587624:0:12970:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587630:0:12970:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587637:0:12970:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587652:0:12970:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895513.587661:0:12970:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1790895513.587665:0:12970:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1790895513.587670:0:12970:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1790895513.587700:0:12970:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1790895513.587704:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:3.0:1790895513.587796:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1790895513.587803:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587811:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cba00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895513.587814:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587832:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895513.587837:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895513.587842:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1790895513.587845:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1790895513.587846:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1790895513.587890:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587896:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895513.587916:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587923:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cba00/0x7911a98710cf8632 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8639 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587936:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790895513.587940:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587946:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cb000 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895513.587948:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587955:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895513.587971:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895513.587975:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790895513.587977:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1790895513.587978:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1790895513.587991:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.587996:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895513.588002:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.588007:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cb000/0x7911a98710cf8934 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf893b expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.588016:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895513.588019:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.588025:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cbe00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895513.588028:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.588034:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895513.588039:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895513.588053:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1790895513.588055:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1790895513.588056:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1790895513.588068:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.588073:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895513.588085:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.588090:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cbe00/0x7911a98710cf83e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf83ed expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895513.588102:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895513.588103:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895513.588105:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895513.588117:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758871296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895513.588154:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895513.588190:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895513.588196:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758871424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895513.588216:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895513.588250:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1790895513.588258:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758871552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895513.588279:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895513.588349:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790895513.588405:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790895513.588415:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:2.0:1790895513.588422:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cf340fab800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790895513.588429:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff8cf33b796000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790895513.588436:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff8cf30643e800 6eb9aba8-c466-4e48-9c75-9d75f799e495 192.168.201.54@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790895513.588443:0:12970:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff8cf3061b8000) has exports, disconnecting them 00000020:00080000:2.0:1790895513.588448:0:12970:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cf340fab800), last request at 1790895509 00000020:00000080:2.0:1790895513.588455:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf85fa 00000100:00080000:2.0:1790895513.588554:0:12970:0:(import.c:65:import_set_state_nolock()) ffff8cf340faa000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790895513.588615:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf340fab800): rc 0 00000020:00000080:2.0:1790895513.588618:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf340fab800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1790895513.588698:0:12970:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8cf33b796000), last request at 1790895509 00000020:00000080:2.0:1790895513.588703:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf852f 00000100:00080000:2.0:1790895513.588773:0:12970:0:(import.c:65:import_set_state_nolock()) ffff8cf33b795800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1790895513.588787:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf33b796000): rc 0 00000020:00000080:2.0:1790895513.588790:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf33b796000/lustre-MDT0000-lwp-OST0000_UUID 00000100:00100000:1.0:1790895513.588886:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871296 00000100:00100000:1.0:1790895513.588894:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871296 00000100:00100000:1.0:1790895513.588936:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871424 00000100:00100000:1.0:1790895513.588939:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871424 00000100:00100000:1.0:1790895513.588951:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871552 00000100:00100000:1.0:1790895513.588954:0:5817:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871552 00000100:00100000:1.0:1790895513.588967:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790895513.588975:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+19:3308:x1877889758871296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895513.589001:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895513.589016:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf8639 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf8632 expref: 19 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.589031:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895513.589072:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+18:3308:x1877889758871296:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895513.589078:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790895513.589094:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790895513.589099:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+17:3308:x1877889758871424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895513.589108:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895513.589117:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf3029cb400/0x7911a98710cf893b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf8934 expref: 17 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.589125:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895513.589146:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+16:3308:x1877889758871424:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895513.589152:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790895513.589172:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790895513.589179:0:5817:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+15:3311:x1877889758871552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895513.589186:0:5817:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895513.589194:0:5817:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167c600/0x7911a98710cf83ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf83e6 expref: 15 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895513.589205:0:5817:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895513.589249:0:5817:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:221ad158-1cb7-4652-832e-1e3667184cca+14:3311:x1877889758871552:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895513.589263:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1790895513.589281:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895513.589289:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895513.589606:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758871552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895513.589635:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758871424:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895513.589643:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758871296:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1790895513.589667:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1790895513.590081:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf340fab800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1790895513.590140:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf340faa000 for lustre-MDT0000 00000004:00000080:2.0:1790895513.590382:0:12970:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9a0b40da3ae0 00000100:00080000:2.0:1790895513.590413:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790895513.590417:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1790895513.590532:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790895513.590590:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1790895513.590614:0:12970:0:(import.c:65:import_set_state_nolock()) ffff8cf332954800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1790895513.590638:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790895513.590641:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1790895513.590651:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1790895513.590715:0:12970:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1790895513.590723:0:12970:0:(import.c:65:import_set_state_nolock()) ffff8cf33facf800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1790895513.590791:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cf3061b8000) has no exports 00000100:00100000:0.0:1790895513.591243:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758871680:0@lo:9:umount.0 00000100:00100000:0.0:1790895513.591306:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895513.591335:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758871808:0@lo:9:umount.0 00000100:00100000:0.0:1790895513.591355:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895513.591385:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871680 00000100:00100000:0.0:1790895513.591392:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871680 00000100:00100000:0.0:1790895513.591432:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871808 00000100:00100000:0.0:1790895513.591434:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871808 00000100:00100000:0.0:1790895513.591455:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790895513.591472:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877889758871680:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790895513.591493:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf857c 00000100:00080000:0.0:1790895513.591500:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf332955000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790895513.591527:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1790895513.591974:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3307:x1877889758871680:12345-0@lo:9:umount.0 Request processed in 502us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895513.591981:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1790895513.591995:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1790895513.592012:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1877889758871808:12345-0@lo:9:umount.0 00000020:00000080:0.0:1790895513.592033:0:6691:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8671 00000100:00080000:0.0:1790895513.592038:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8cf20129d800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1790895513.592056:0:6691:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1790895513.592251:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3307:x1877889758871808:12345-0@lo:9:umount.0 Request processed in 239us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895513.592257:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1790895513.592277:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790895513.592280:0:5827:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895513.592307:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf332954800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:3.0:1790895513.592360:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33b796000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1790895513.592404:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf33b795800 for lustre-MDT0000 00010000:00010000:1.0:1790895513.592734:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895513.592739:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1790895513.592843:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790895513.592846:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790895513.592850:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758871680:0@lo:9:umount.0 00000100:00080000:0.0:1790895513.593154:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf33facf800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1790895513.593169:0:3307:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1790895513.593170:0:3307:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1790895513.593173:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758871808:0@lo:9:umount.0 00000020:00080000:2.0:1790895513.599280:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff8cf3061b8000) has no exports 00000020:00000080:2.0:1790895513.655627:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8441 00000020:00000080:2.0:1790895513.655645:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf340fc4000/lustre-QMT0000_UUID 00000020:01000000:2.0:1790895513.655667:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1790895513.655706:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf340fc4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1790895513.656576:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790895513.656588:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790895513.656593:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff8cf340fb4d40) has no exports 00000020:00000080:3.0:1790895513.657005:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf843a 00000020:00000080:3.0:1790895513.657012:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf340fa9800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790895513.657068:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790895513.657074:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790895513.657077:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf340fae000/lustre-QMT0000_UUID 00000020:00000080:3.0:1790895513.657079:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf340fae000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1790895513.657083:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:0.0:1790895513.657267:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf340fa9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000001:00100000:0.0:1790895514.120291:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790895514.120302:0:7641:0:(genops.c:885:class_export_put()) final put ffff8cf20129e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790895514.120362:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf20129e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1790895514.120412:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf20129d800 for lustre-OST0001 00010000:00010000:3.0:1790895514.328034:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895515.096353:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758872064:0@lo:400:kworker.0 00000100:00100000:2.0:1790895515.096438:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895515.096502:0:7639:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758872064 00000100:00100000:1.0:1790895515.096512:0:7639:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758872064 00000100:00100000:2.0:1790895515.096529:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895515.096539:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758872192:0@lo:400:kworker.0 00000100:00100000:2.0:1790895515.096567:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895515.096570:0:7639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1790895515.096582:0:7639:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1877889758872064:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1790895515.096592:0:7639:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1790895515.096626:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758872192 00000100:00100000:2.0:1790895515.096631:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758872192 00000100:00100000:2.0:1790895515.096657:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1790895515.096664:0:7639:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3308:x1877889758872064:12345-0@lo:400:kworker.0 Request processed in 81us (224us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790895515.096665:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1877889758872192:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1790895515.096676:0:5833:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1790895515.096680:0:7639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:1.0:1790895515.096732:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790895515.096737:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8cf20114d800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790895515.096742:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1790895515.096788:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758871936:0@lo:400:kworker.0 00000100:00100000:2.0:1790895515.097361:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1877889758872192:12345-0@lo:400:kworker.0 Request processed in 695us (792us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790895515.097368:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1790895515.098451:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895515.098649:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758871936 00000100:00100000:2.0:1790895515.098658:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758871936 00000100:00100000:2.0:1790895515.098930:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1790895515.098956:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:3311:x1877889758871936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895515.099021:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf303119c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:221ad158-1cb7-4652-832e-1e3667184cca+14:3311:x1877889758871936:12345-0@lo:400:kworker.0 Request processed in 68us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895515.099036:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1790895515.099129:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758871936:0@lo:400:kworker.0 00000100:00080000:1.0:1790895515.111764:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8cf20114d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790895515.111781:0:3308:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 189 00000100:00080000:1.0:1790895515.111804:0:3308:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cf20114d800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:1.0:1790895515.111908:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf308d5ca80 x1877889758872320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790895515.111949:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758872064:0@lo:400:kworker.0 00000100:00080000:1.0:1790895515.112018:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1790895515.112023:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8cf30fc30000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1790895515.112028:0:3308:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1790895515.112047:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8cf30fc30000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790895515.112053:0:3308:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 208 00000100:00080000:1.0:1790895515.112061:0:3308:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cf30fc30000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:1.0:1790895515.112080:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf3031f4380 x1877889758872448/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790895515.112094:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758872192:0@lo:400:kworker.0 00000100:00100000:1.0:1790895515.112897:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf308d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758872320:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790895515.112989:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895515.113022:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758872448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1790895515.113047:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895515.120532:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758872320 00000100:00100000:3.0:1790895515.120551:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758872320 00000100:00100000:3.0:1790895515.120609:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758872448 00000100:00100000:3.0:1790895515.120613:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758872448 00000100:00100000:3.0:1790895515.120654:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1790895515.120662:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1877889758872320:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1790895515.120697:0:5831:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790895515.120744:0:12417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1790895515.120751:0:12417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1877889758872448:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:1.0:1790895515.120761:0:12417:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1790895515.120902:0:12417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3307:x1877889758872448:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 149us (7854us total) trans 0 rc -19/-19 00000100:00100000:1.0:1790895515.120909:0:12417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1790895515.120958:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf30fc30000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790895515.120963:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790895515.120967:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3031f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758872448:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1790895515.129358:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1877889758872320:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 8686us (16360us total) trans 0 rc -19/-19 00000100:00100000:3.0:1790895515.129373:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1790895515.130451:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf20114d800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790895515.130468:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1790895515.130473:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf308d5ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758872320:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1790895515.352494:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1790895516.195393:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1790895516.195402:0:6715:0:(genops.c:885:class_export_put()) final put ffff8cf332957800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790895516.195643:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf332957800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1790895516.195705:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf332955000 for lustre-OST0000 00000001:00100000:1.0:1790895516.215085:0:5854:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6eb9aba8-c466-4e48-9c75-9d75f799e495 00000001:00080000:1.0:1790895516.215102:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1790895516.215108:0:5854:0:(genops.c:885:class_export_put()) final put ffff8cf30643e800/6eb9aba8-c466-4e48-9c75-9d75f799e495 00000020:00000080:0.0:1790895516.215173:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30643e800/6eb9aba8-c466-4e48-9c75-9d75f799e495 for lustre-MDT0000 00000020:00000080:0.0:1790895516.215246:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf30643b800 for lustre-MDT0000 00010000:00010000:1.0:1790895516.382077:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895517.401110:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895518.424956:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895519.451748:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1790895519.704173:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf310c056c0 - data ffff8cf33076c798/ffff8cf3405dfc00 00000020:01000000:1.0:1790895519.704337:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf318c31d20 - data ffff8cf32a82a000/ffff8cf340fa3000 00000001:00000004:1.0:1790895519.711281:0:12970:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:2.0:1790895519.862551:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1790895519.862560:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1790895519.862745:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790895519.862749:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790895519.878024:0:6874:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790895519.878032:0:6874:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:3.0:1790895519.878043:0:6874:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1790895519.879081:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1790895519.879087:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1790895519.879111:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1790895519.879123:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1790895519.890738:0:7921:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1790895519.890748:0:7921:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:3.0:1790895519.890766:0:7921:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1790895519.959461:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8409 00000020:00000080:1.0:1790895519.959476:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf311606000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1790895519.960954:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf311606000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790895519.961314:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf841e 00000020:00000080:1.0:1790895519.961321:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf30fc36800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1790895519.961371:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1790895519.961378:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895519.961386:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790895519.961390:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff8cf3061bb380) has no exports 00000004:01000000:1.0:1790895519.961546:0:12970:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1790895519.961554:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf865c 00000020:00000080:1.0:1790895519.961559:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf202b2d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1790895519.963191:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30fc36800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790895519.963347:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790895519.963354:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895519.963364:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790895519.963369:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff8cf203044d40) has no exports 00000020:00000080:1.0:1790895519.963376:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8655 00000020:00000080:1.0:1790895519.963383:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf33faca800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1790895519.963737:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf202b2d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790895519.963749:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33faca800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1790895519.964057:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790895519.964062:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1790895519.964066:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1790895519.964072:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790895519.964074:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790895519.964170:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895519.964179:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790895519.964190:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8575 00000020:00000080:1.0:1790895519.964196:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf30fc34000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790895519.964361:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf33facf800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1790895519.964368:0:36:0:(genops.c:885:class_export_put()) final put ffff8cf20129a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790895519.964370:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf20129a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1790895519.964375:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790895519.964813:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1790895519.964819:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895519.964824:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1790895519.964827:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff8cf3065099c0) has no exports 00000020:00000080:1.0:1790895519.964833:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf856e 00000020:00000080:1.0:1790895519.964837:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf332952800/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1790895519.965296:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1790895519.965301:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1790895519.965305:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1790895519.965310:0:12970:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1790895519.965312:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790895519.965346:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895519.965351:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790895519.965384:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895519.965388:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790895519.965391:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf310bba800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1790895519.965394:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf310bba800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1790895519.965401:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1790895519.965550:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8425 00000020:00000080:1.0:1790895519.965556:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf30fc33000/lustre-MDD0000_UUID 00000020:01000000:1.0:1790895519.965564:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1790895519.965567:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895519.965570:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1790895519.965572:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff8cf30650b380) has no exports 00000020:00000080:1.0:1790895519.965593:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895519.965596:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1790895519.965610:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf842c 00000020:00000080:1.0:1790895519.965614:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf30fc31800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790895519.965633:0:12970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf303072000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1790895519.965636:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf303072000 3 00000020:01000004:1.0:1790895519.965639:0:12970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf303072000 from lustre-MDT0000 00000020:00000080:1.0:1790895519.965658:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895519.965663:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1790895519.965665:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf311605800/lustre-MDT0000_UUID 00000020:00000080:1.0:1790895519.965667:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf311605800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1790895519.965674:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1790895519.965700:0:12970:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1790895519.965703:0:12970:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1790895519.965705:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1790895519.965708:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895519.965711:0:12970:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790895519.965716:0:12970:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff8cf305a2f000 221ad158-1cb7-4652-832e-1e3667184cca 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790895519.965721:0:12970:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff8cf3061b99c0) has exports, disconnecting them 00000020:00080000:1.0:1790895519.965726:0:12970:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8cf305a2f000), last request at 1790895296 00000020:00000080:1.0:1790895519.965740:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf83ca 00000020:00010000:1.0:1790895519.965744:0:12970:0:(genops.c:1920:obd_stale_export_put()) Put export ffff8cf305a2f000: total 4 00000100:00080000:1.0:1790895519.965748:0:12970:0:(import.c:65:import_set_state_nolock()) ffff8cf30853f800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1790895519.965768:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf305a2f000): rc 0 00000020:00080000:1.0:1790895519.965772:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff8cf3061b99c0) has no exports 00000100:00100000:1.0:1790895519.965994:0:5826:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff8cf30603da00:5826] 2 exiting: rc = 0 00000020:00010000:3.0:1790895519.966129:0:5819:0:(genops.c:1906:obd_stale_export_get()) Get export ffff8cf305a2f000: total 4 00010000:00010000:3.0:1790895519.966160:0:5819:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8cf305a2f000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1790895519.966190:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf300031800/0x7911a98710cf872e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf8727 expref: 9 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966207:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84f000/0x7911a98710cf892d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf8926 expref: 8 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966217:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301522e00/0x7911a98710cf84e2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf84db expref: 7 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966233:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7dc00/0x7911a98710cf86da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf86d3 expref: 6 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966244:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301523000/0x7911a98710cf86e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf86e1 expref: 5 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966255:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf300030a00/0x7911a98710cf8704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf86fd expref: 4 pid: 5825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966280:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf301522c00/0x7911a98710cf86f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf86ef expref: 3 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966294:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f91c200/0x7911a98710cf891f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7911a98710cf8918 expref: 2 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895519.966305:0:5819:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8cf305a2f000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1790895519.966318:0:5819:0:(genops.c:885:class_export_put()) final put ffff8cf305a2f000/221ad158-1cb7-4652-832e-1e3667184cca 00010000:00010000:3.0:1790895519.966323:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895519.966325:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895519.966326:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895519.966347:0:5825:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff8cf305909200:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1790895519.966546:0:5824:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff8cf305908c00:5824] 0 exiting: rc = 1 00000020:00000080:2.0:1790895519.966596:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30fc34000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790895519.966610:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf332952800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790895519.966616:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf332954800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1790895519.966621:0:36:0:(genops.c:885:class_export_put()) final put ffff8cf33faca000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1790895519.966622:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33faca000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1790895519.966626:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790895519.966710:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30fc33000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1790895519.966714:0:36:0:(genops.c:885:class_export_put()) final put ffff8cf310bbc800/lustre-MDD0000_UUID 00000020:00000080:2.0:1790895519.966722:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf310bbc800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1790895519.966725:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1790895519.966901:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30fc31800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790895519.966906:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf305a2f000/221ad158-1cb7-4652-832e-1e3667184cca for MGS 00000020:00000080:2.0:1790895519.966942:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf30853f800 for MGS 00000100:00100000:1.0:1790895519.967161:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967170:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967177:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967184:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967189:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967194:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967200:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967205:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967211:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967217:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967232:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967238:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967243:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967261:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967266:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967272:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967277:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967282:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967287:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967293:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967298:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967303:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967310:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967315:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967320:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967325:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967331:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967336:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967340:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967346:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967351:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967356:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967362:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967368:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967373:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967378:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967383:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967389:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967394:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967399:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967404:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967410:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967415:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967420:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967425:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967437:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967443:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967447:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967453:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967457:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967463:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967468:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967473:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967478:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967482:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967488:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967493:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967498:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967502:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967508:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967513:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967517:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967521:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895519.967526:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1790895519.968191:0:12970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790895519.968203:0:12970:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:1.0:1790895519.971067:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf308429ae0 - data ffff8cf32aa37a20/ffff8cf2020dcc00 00000020:01000000:1.0:1790895519.971219:0:12970:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf30647d3c0 - data ffff8cf32a8045e8/ffff8cf306092000 00000020:00000080:1.0:1790895519.971766:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf83ae 00000020:00000080:1.0:1790895519.971775:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf318f0a800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1790895519.971836:0:12970:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf303072000 from MGS, refs=2 00000020:01000004:1.0:1790895519.971840:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf303072000 2 00000020:01000004:1.0:1790895519.971843:0:12970:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf303072000 from MGS 00000020:00000080:1.0:1790895519.971881:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895519.971888:0:12970:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1790895519.971891:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf318f0a000/MGS 00000020:00000080:1.0:1790895519.971894:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf318f0a000/MGS for MGS 00000020:01000000:1.0:1790895519.971900:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1790895519.971961:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1790895519.971977:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895519.971982:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1790895519.971989:0:12970:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8cf33909e000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1790895519.971994:0:12970:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff8cf3031a8000) has exports, disconnecting them 00000020:00080000:1.0:1790895519.971998:0:12970:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8cf33909e000), last request at 1790895297 00000020:00000080:1.0:1790895519.972002:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8479 00000020:00080000:1.0:1790895519.972013:0:12970:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf33909e000): rc 0 00000020:00000080:1.0:1790895519.972017:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf33909e000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1790895519.972805:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf318f0a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1790895519.973679:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33909e000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1790895520.041008:0:12970:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1790895520.041016:0:12970:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790895520.041021:0:12970:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790895520.041028:0:12970:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1790895520.041215:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790895520.041241:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1790895520.041248:0:12970:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf303072000 1 00000020:00000080:2.0:1790895520.041272:0:12970:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf83a0 00000020:00000080:2.0:1790895520.041281:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf318f0f000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1790895520.041297:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1790895520.041303:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790895520.041307:0:12970:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1790895520.041333:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff8cf3077c3380) has no exports 00000020:00000080:3.0:1790895520.041549:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf33909c800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1790895520.041557:0:8:0:(genops.c:885:class_export_put()) final put ffff8cf307f57800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1790895520.041570:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf307f57800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1790895520.041581:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1790895520.041650:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf318f0f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1790895520.102043:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895520.102059:0:12970:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1790895520.102064:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf303077000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1790895520.102069:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf303077000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1790895520.102075:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1790895520.102217:0:12970:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cf303077800 00000020:01000000:1.0:1790895520.102250:0:12970:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1790895520.102255:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895520.102259:0:12970:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790895520.102263:0:12970:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff8cf3061bcd40) has no exports 00000100:00100000:1.0:1790895520.102350:0:12417:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff8cf33fd75400:12417] 4 exiting: rc = 0 00000100:00100000:3.0:1790895520.102652:0:5833:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff8cf3180cb800:5833] 2 exiting: rc = 0 00000100:00100000:3.0:1790895520.102710:0:5831:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff8cf318eb4000:5831] 0 exiting: rc = 1 00000100:00100000:2.0:1790895520.106588:0:7639:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff8cf336baf000:7639] 3 exiting: rc = 0 00000100:00100000:0.0:1790895520.106976:0:5832:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff8cf318eb5200:5832] 1 exiting: rc = 0 00000100:00100000:1.0:1790895520.107299:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107307:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107313:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107319:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107324:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107330:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107349:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107355:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107360:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107365:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107371:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107376:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107381:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107401:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107407:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107413:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107419:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107424:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107430:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107436:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107441:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107447:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107454:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107460:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107466:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107471:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107477:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107483:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107487:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107492:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107498:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107502:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107508:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107514:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107520:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107526:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107532:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107538:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107544:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107550:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107555:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107560:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107565:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107570:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107576:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107581:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107589:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107595:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107618:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107623:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107630:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107636:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107643:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107649:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107654:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107660:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107665:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107670:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107676:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107681:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107686:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107692:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107697:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.107703:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895520.114310:0:5835:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8cf305908e00:5835] 1 exiting: rc = 0 00000100:00100000:0.0:1790895520.114715:0:5834:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8cf31fe7e200:5834] 0 exiting: rc = 1 00000100:00100000:1.0:1790895520.115899:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115908:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115914:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115919:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115925:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115930:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115938:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115943:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115950:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115957:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115962:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115967:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115974:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115979:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115984:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115989:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115994:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.115999:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116004:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116023:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116028:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116034:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116039:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116043:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116048:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116053:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116058:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116062:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116067:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116072:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116076:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116081:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116086:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116090:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116096:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116100:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116105:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116120:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116125:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116130:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116135:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116140:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116146:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116151:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116156:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116160:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116165:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116169:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116173:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116178:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116183:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116188:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116193:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116198:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116210:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116215:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116219:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116224:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116229:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116234:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116239:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116243:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116247:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.116252:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.117212:0:5837:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff8cf311608200:5837] 1 exiting: rc = 0 00000100:00100000:1.0:1790895520.118205:0:5836:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff8cf311632200:5836] 0 exiting: rc = 1 00000100:00100000:1.0:1790895520.118277:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118285:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118299:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118307:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118314:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118320:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118326:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118356:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118364:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118370:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118377:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118383:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118390:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118396:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118402:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118408:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118415:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118421:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118428:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118446:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118453:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118459:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118466:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118484:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118490:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118496:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118503:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118509:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118515:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118521:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118528:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118545:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118552:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118558:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118565:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118579:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118585:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118590:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118603:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118610:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118616:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118622:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118628:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118646:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118653:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118659:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118665:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118671:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118677:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118682:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118688:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118694:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118701:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118707:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118713:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118730:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118743:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118750:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118762:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118768:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118775:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118782:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118788:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.118796:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895520.131148:0:5839:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8cf3031d2000:5839] 1 exiting: rc = 0 00000100:00100000:2.0:1790895520.131356:0:5838:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8cf31861f600:5838] 0 exiting: rc = 1 00000100:00100000:1.0:1790895520.131497:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131504:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131511:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131516:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131522:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131527:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131532:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131537:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131542:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131548:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131553:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131558:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131563:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131568:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131573:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131578:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131583:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131588:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131593:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131599:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131604:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131609:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131614:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131618:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131623:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131627:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131633:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131637:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131642:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131662:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131666:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131672:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131677:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131682:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131688:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131693:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131699:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131703:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131708:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131712:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131717:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131721:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131726:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131731:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131735:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131739:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131744:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131748:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131752:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131756:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131761:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131766:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131771:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131776:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131781:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131786:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131791:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131796:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131802:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131807:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131812:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131816:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131820:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.131825:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895520.132535:0:5840:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8cf3031d2e00:5840] 0 exiting: rc = 1 00000100:00100000:3.0:1790895520.132770:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8cf3031d2600:5841] 1 exiting: rc = 0 00000100:00100000:1.0:1790895520.134091:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134100:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134106:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134178:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134183:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134189:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134194:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134200:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134206:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134213:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134218:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134223:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134229:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134235:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134240:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134246:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134250:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134255:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134260:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134265:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134271:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134275:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134281:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134285:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134290:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134295:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134301:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134307:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134312:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134317:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134323:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134328:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134513:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134522:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134528:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134546:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134551:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134556:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134562:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134567:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134572:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134578:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134583:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134588:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134605:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134610:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134797:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134802:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134807:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134811:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134816:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134820:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134824:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134828:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134834:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134838:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.134848:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.135101:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.135195:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.135201:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.135206:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.135211:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.135215:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.135220:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895520.135938:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff8cf3031d3800:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1790895520.141675:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff8cf3031d3000:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1790895520.141840:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141849:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141854:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141886:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141894:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141898:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141923:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141928:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141933:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141938:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141942:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141947:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141952:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141957:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141962:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141966:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141971:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141976:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141980:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141985:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141990:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.141995:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142001:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142006:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142011:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142016:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142022:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142027:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142032:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142037:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142042:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142048:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142052:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142057:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142063:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142067:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142072:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142076:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142081:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142086:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142091:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142103:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142118:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142122:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142127:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142131:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142136:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142140:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142145:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142149:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142154:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142159:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142163:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142167:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142173:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142178:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142182:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142187:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142192:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142197:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142201:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142205:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142210:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.142215:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895520.142954:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff8cf3031d2c00:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1790895520.143253:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff8cf3031d3200:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1790895520.150547:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff8cf3031d3a00:5846] 2 exiting: rc = 0 00000100:00100000:1.0:1790895520.150739:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150746:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150752:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150757:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150769:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150792:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150798:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150804:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150809:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150815:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150820:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150825:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150837:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150842:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150847:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150852:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150884:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150890:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.150896:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151028:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151038:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151045:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151051:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151057:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151061:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151066:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151072:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151077:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151083:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151102:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151212:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151221:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151227:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151232:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151239:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151244:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151250:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151255:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151261:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151266:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151271:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151277:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151283:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151288:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151293:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151299:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151305:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151318:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151324:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151330:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151716:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151723:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151729:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151750:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151756:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151763:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151768:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151774:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151780:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151785:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151791:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151797:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151802:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1790895520.151808:0:12970:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1790895520.166309:0:12970:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895520.166322:0:12970:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1790895520.166327:0:12970:0:(genops.c:885:class_export_put()) final put ffff8cf311604800/MDS_uuid 00000020:00000080:1.0:1790895520.166332:0:12970:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf311604800/MDS_uuid for MDS 00000020:01000000:1.0:1790895520.166658:0:12970:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1790895520.166785:0:12970:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00080000:1.0:1790895520.217128:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790895520.217136:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790895520.217140:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf20114d800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790895520.217148:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 388 00000100:00080000:1.0:1790895520.217155:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790895520.217169:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cf20114d800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:1.0:1790895520.217195:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf3397f1c00 x1877889758872704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790895520.217212:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1790895520.217229:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1790895520.217231:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf30fc30000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1790895520.217235:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 388 00000100:00080000:1.0:1790895520.217238:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1790895520.217243:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cf30fc30000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:1.0:1790895520.217256:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf3397f2d80 x1877889758872832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790895520.217279:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1790895520.217294:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758872576:0@lo:400:kworker.0 00000400:00000100:1.0:1790895520.217341:0:3311:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877889758872576 offset 0 length 224: 4 00000100:00100000:2.0:1790895520.219755:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758872704:0@lo:38:kworker.0 00000400:00000100:2.0:1790895520.219808:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877889758872704 offset 0 length 520: 4 00000100:00100000:2.0:1790895520.226559:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758872832:0@lo:38:kworker.0 00000400:00000100:2.0:1790895520.226649:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1877889758872832 offset 0 length 520: 4 00010000:00010000:2.0:1790895520.480949:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895521.496989:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895522.521434:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895523.544047:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1790895523.611199:0:13125:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1790895523.640043:0:13125:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1790895523.640110:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.640125:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.640132:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.640140:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.640160:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1790895523.640165:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1790895523.640191:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790895523.640203:0:13125:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf3397f1c00 x1877889758872704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790895535 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895523.640240:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1790895523.640247:0:13125:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1790895523.640253:0:13125:0:(import.c:65:import_set_state_nolock()) ffff8cf20114d800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1790895523.640259:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1790895523.640263:0:13125:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf3397f1c00 x1877889758872704/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790895535 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895523.640270:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1790895523.640273:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:2.0:1790895523.640507:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758872704:0@lo:38:kworker.0 00010000:00010000:0.0:1790895523.640677:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895523.640686:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895523.640695:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf300031e00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895523.640709:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895523.640718:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895523.640726:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895523.640731:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790895523.640734:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790895523.640736:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790895523.640772:0:5820:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895523.640779:0:5820:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790895523.640806:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895523.640814:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf300031e00/0x7911a98710cf86ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf86f6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895523.640825:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895523.640827:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895523.640829:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895523.641111:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758872960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790895523.641181:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895523.642816:0:11170:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758872960 00000100:00100000:0.0:1790895523.642829:0:11170:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758872960 00000100:00100000:0.0:1790895523.642897:0:11170:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790895523.642907:0:11170:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1877889758872960:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1790895523.642913:0:11170:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790895523 with bad export cookie 8723940350761075658 00010000:00010000:1.0:1790895523.644826:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.644844:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.644851:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.645038:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.645224:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895523.645237:0:13125:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.645246:0:13125:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.645252:0:13125:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895523.645272:0:13125:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.652824:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790895523.652842:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.652979:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ce00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895523.652984:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.652994:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895523.653002:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895523.653009:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1790895523.653011:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1790895523.653065:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.653072:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895523.653124:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.653132:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7ce00/0x7911a98710cf86fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf8704 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.653145:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895523.653149:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.653156:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf3029cac00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:3.0:1790895523.653159:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.655683:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1790895523.655692:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895523.656508:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1790895523.656513:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1790895523.656622:0:5819:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.656630:0:5819:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1790895523.656645:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895523.656659:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895523.656662:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895523.656665:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895523.658325:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758873088:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790895523.658400:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895523.658459:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895523.658465:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758873216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790895523.658489:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895523.658518:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758873088 00000100:00100000:2.0:1790895523.658525:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758873088 00000100:00100000:2.0:1790895523.658571:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758873216 00000100:00100000:2.0:1790895523.658574:0:5816:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758873216 00000100:00100000:2.0:1790895523.658586:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790895523.658595:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1877889758873088:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790895523.658602:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790895523 with bad export cookie 8723940350761075658 00000100:00100000:2.0:1790895523.658647:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1877889758873088:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (246us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790895523.658653:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1790895523.658669:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790895523.658673:0:5816:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf306587c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1877889758873216:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1790895523.658677:0:5816:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1790895523 with bad export cookie 8723940350761075658 00000100:00100000:2.0:1790895523.658701:0:5816:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf306587c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3308:x1877889758873216:12345-0@lo:103:ldlm_bl.0 Request processed in 28us (211us total) trans 0 rc -107/-107 00000100:00100000:2.0:1790895523.658723:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1790895523.658757:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790895523.658762:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8cf318f09800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1790895523.658765:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.154@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1790895523.661659:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895523.661729:0:13125:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1790895523.661742:0:13125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf3029cac00/0x7911a98710cf8926 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x7911a98710cf892d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895523.661764:0:13125:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1790895523.661773:0:13125:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:1.0:1790895523.661775:0:13125:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1790895523.661813:0:13125:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1790895523.661818:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1790895523.661827:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1790895523.661834:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1790895523.661839:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cf306508000) has no exports 00000020:00080000:1.0:1790895523.661887:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff8cf306508000) has no exports 00000100:00100000:0.0:1790895523.665329:0:11170:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1877889758872960:12345-0@lo:103:ldlm_bl.0 Request processed in 22417us (24143us total) trans 0 rc -107/-107 00000100:00100000:0.0:1790895523.665343:0:11170:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:01000000:1.0:1790895523.670600:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf310c05ea0 - data ffff8cf32ab2c6c0/ffff8cf34061d800 00000020:01000000:1.0:1790895523.672387:0:13125:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf307f4f240 - data ffff8cf32ab5b288/ffff8cf33fac3000 00000100:00080000:3.0:1790895523.685107:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.154@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1790895523.700671:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.154@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1790895523.700677:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790895523.700688:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf3397f1f80 x1877889758872576/t0(0) o400->MGC192.168.201.154@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790895536 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895523.702404:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf318e36300 x1877889758872960/t0(0) o103->MGC192.168.201.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790895539 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895523.702418:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf336e34e00 x1877889758873088/t0(0) o103->MGC192.168.201.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790895539 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895523.702428:0:3308:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf336e34000 x1877889758873216/t0(0) o103->MGC192.168.201.154@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1790895539 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790895523.702437:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790895523.702441:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790895523.702442:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1790895523.702490:0:3311:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8cf318f09800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1790895523.702641:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758872576:0@lo:400:kworker.0 00000100:00100000:0.0:1790895523.702676:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:221ad158-1cb7-4652-832e-1e3667184cca:3311:1877889758872960:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1790895523.703125:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8cf318f09800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895523.703131:0:3308:0:(import.c:545:import_select_connection()) MGC192.168.201.154@tcp: connect to NID 0@lo last attempt 169 00000100:00080000:2.0:1790895523.703146:0:3308:0:(import.c:666:import_select_connection()) MGC192.168.201.154@tcp: import ffff8cf318f09800 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:3.0:1790895523.703375:0:3308:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf336e35500 x1877889758873344/t0(0) o250->MGC192.168.201.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895523.703436:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:221ad158-1cb7-4652-832e-1e3667184cca:3307:1877889758873344:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1790895523.703491:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1877889758873344 offset 0 length 520: 4 00000100:00100000:3.0:1790895523.703608:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758873088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1790895523.703623:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:221ad158-1cb7-4652-832e-1e3667184cca:3308:1877889758873216:0@lo:103:ldlm_bl.0 00100000:10000000:0.0:1790895523.718387:0:13125:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790895523.756767:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf84fe 00000020:00000080:2.0:1790895523.756779:0:13125:0:(genops.c:885:class_export_put()) final put ffff8cf33facb000/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1790895523.756802:0:13125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf310bbd000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1790895523.756806:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf310bbd000 2 00000020:01000004:2.0:1790895523.756810:0:13125:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf310bbd000 from lustre-OST0000 00000020:00000080:2.0:1790895523.756851:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790895523.756887:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1790895523.756891:0:13125:0:(genops.c:885:class_export_put()) final put ffff8cf30fc37800/lustre-OST0000_UUID 00000020:00000080:2.0:1790895523.756894:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30fc37800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1790895523.756902:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1790895523.756941:0:13125:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1790895523.756945:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1790895523.756948:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790895523.756953:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1790895523.756959:0:13125:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8cf33b797800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1790895523.756965:0:13125:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff8cf3077c19c0) has exports, disconnecting them 00000020:00080000:2.0:1790895523.756970:0:13125:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8cf33b797800), last request at 1790895316 00000020:00000080:2.0:1790895523.756974:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8528 00000020:00080000:2.0:1790895523.756981:0:13125:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf33b797800): rc 0 00000020:00000080:2.0:1790895523.756985:0:13125:0:(genops.c:885:class_export_put()) final put ffff8cf33b797800/lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1790895523.757668:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33facb000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790895523.757684:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33b797800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1790895523.770237:0:13125:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1790895523.770247:0:13125:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1790895523.770251:0:13125:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1790895523.770259:0:13125:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1790895523.770467:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf20114d800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1790895523.778148:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1790895523.778164:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1790895523.778170:0:13125:0:(genops.c:885:class_export_put()) final put ffff8cf33f823000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1790895523.778175:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33f823000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1790895523.778186:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1790895523.778242:0:13125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf310bbd000 1 00000020:00000080:0.0:1790895523.778248:0:13125:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf84b8 00000020:00000080:0.0:1790895523.778256:0:13125:0:(genops.c:885:class_export_put()) final put ffff8cf3061f9000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1790895523.778264:0:13125:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1790895523.778269:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790895523.778274:0:13125:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1790895523.778277:0:13125:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff8cf3077c0000) has no exports 00000020:00000080:1.0:1790895523.778472:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3061f9000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1790895523.823943:0:13125:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1790895523.823958:0:13125:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1790895523.823965:0:13125:0:(genops.c:885:class_export_put()) final put ffff8cf3328d6800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1790895523.823969:0:13125:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3328d6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1790895523.823980:0:13125:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1790895523.824139:0:13125:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cf310bbb000 00000020:02000400:1.0:1790895523.824211:0:13125:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1790895524.572592:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790895525.345382:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) 221ad158-1cb7-4652-832e-1e3667184cca->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790895525.345394:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) 221ad158-1cb7-4652-832e-1e3667184cca->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790895525.345398:0:12643:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1790895525.345401:0:12643:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1790895525.595177:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895526.615994:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790895527.136448:0:13275:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:3.0:1790895527.154253:0:13275:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1790895527.154331:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895527.154347:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895527.154355:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895527.154363:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.154642:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1790895527.154649:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1790895527.154672:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790895527.154685:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf3397f2d80 x1877889758872832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790895535 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895527.154712:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1790895527.154715:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00080000:2.0:1790895527.154719:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1790895527.154723:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790895527.154724:0:13275:0:(import.c:65:import_set_state_nolock()) ffff8cf30fc30000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1790895527.154730:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1790895527.154730:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf300030200 already unused, calling callback (ffffffffc1a76c20) 00000100:00100000:2.0:1790895527.154734:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf3397f2d80 x1877889758872832/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790895535 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:0.0:1790895527.154735:0:5820:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895527.154742:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00010000:00010000:0.0:1790895527.154744:0:5820:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895527.154745:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 10s for inflight to error out 10000000:00010000:0.0:1790895527.154752:0:5820:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895527.154757:0:5820:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790895527.154760:0:5820:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1790895527.154762:0:5820:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1790895527.154777:0:5820:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf318f09800 00010000:00010000:0.0:1790895527.154781:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.154788:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf300030200/0x7911a98710cf86d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf86da expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.154800:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895527.154809:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895527.154810:0:5820:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895527.157093:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758872832:0@lo:38:kworker.0 00010000:00010000:2.0:1790895527.161891:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161912:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161920:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161928:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161950:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895527.161958:0:13275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161964:0:13275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161970:0:13275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161977:0:13275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.161999:0:13275:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1790895527.162004:0:13275:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1790895527.162025:0:13275:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1790895527.162029:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1790895527.162034:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790895527.162039:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790895527.162057:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cf3031acd40) has no exports 00000020:00080000:2.0:1790895527.162082:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff8cf3031acd40) has no exports 00010000:00010000:0.0:1790895527.162114:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790895527.162122:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162130:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d400 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895527.162133:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162142:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895527.162150:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895527.162155:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1790895527.162157:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1790895527.162160:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1790895527.162174:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf318f09800 00010000:00010000:0.0:1790895527.162178:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162184:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d400/0x7911a98710cf86e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf86e8 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162196:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895527.162198:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162204:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c400 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895527.162213:0:5819:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162220:0:5819:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895527.162226:0:5819:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895527.162232:0:5819:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1790895527.162233:0:5819:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1790895527.162235:0:5819:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1790895527.162240:0:5819:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf318f09800 00010000:00010000:0.0:1790895527.162243:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162249:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c400/0x7911a98710cf8918 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf891f expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895527.162261:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895527.162263:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895527.162264:0:5819:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790895527.163834:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf310c05c00 - data ffff8cf330732d80/ffff8cf34061e800 00010000:00010000:1.0:1790895527.164352:0:6704:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1790895527.172639:0:13275:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8cf2037ae360 - data ffff8cf32ab2cca8/ffff8cf33fa56800 00100000:10000000:1.0:1790895527.207691:0:13275:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1790895527.291910:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf85c9 00000020:00000080:2.0:1790895527.291922:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf33b792000/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1790895527.291937:0:13275:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf332953800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1790895527.291940:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf332953800 2 00000020:01000004:2.0:1790895527.291943:0:13275:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8cf332953800 from lustre-OST0001 00000020:00000080:2.0:1790895527.291969:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790895527.291979:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1790895527.291981:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf3371fe800/lustre-OST0001_UUID 00000020:00000080:2.0:1790895527.291984:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3371fe800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1790895527.292004:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1790895527.292120:0:13275:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 221ad158-1cb7-4652-832e-1e3667184cca->MGS 00010000:00010000:2.0:1790895527.292136:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf84e2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895527.292148:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf84e2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895527.292156:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1790895527.292158:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1790895527.292162:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1790895527.292179:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf318f09800 00010000:00010000:2.0:1790895527.292182:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf30167c800/0x7911a98710cf84db lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf84e2 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895527.292196:0:13275:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7911a98710cf872e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895527.292215:0:13275:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7911a98710cf872e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895527.292221:0:13275:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1790895527.292224:0:13275:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1790895527.292225:0:13275:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1790895527.292236:0:13275:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8cf318f09800 00010000:00010000:2.0:1790895527.292239:0:13275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf301522400/0x7911a98710cf8727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7911a98710cf872e expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1790895527.292255:0:13275:0:(import.c:65:import_set_state_nolock()) ffff8cf318f09800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1790895527.292258:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1790895527.292260:0:13275:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1790895527.292261:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1790895527.292265:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1790895527.292275:0:13275:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8cf336e35500 x1877889758873344/t0(0) o250->MGC192.168.201.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1790895533 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1790895527.292296:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790895527.292298:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:3.0:1790895527.292474:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:221ad158-1cb7-4652-832e-1e3667184cca:3307:1877889758873344:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:2.0:1790895527.293909:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790895527.293925:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf83bc 00000020:00000080:2.0:1790895527.293932:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf303046000/221ad158-1cb7-4652-832e-1e3667184cca 00000020:01000000:2.0:1790895527.293942:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.154@tcp (flags='') 00000020:00000080:2.0:1790895527.293951:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790895527.293958:0:13275:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.154@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1790895527.293962:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff8cf3031ab380) has no exports 10000000:01000000:3.0:1790895527.294066:0:5828:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:0.0:1790895527.294193:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf33b792000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1790895527.294212:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf303046000/221ad158-1cb7-4652-832e-1e3667184cca for MGC192.168.201.154@tcp 10000000:01000000:2.0:1790895527.294213:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.154@tcp: client import never connected 00000100:00080000:2.0:1790895527.294220:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1790895527.294224:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1790895527.294228:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1790895527.294241:0:13275:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1790895527.294295:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790895527.294301:0:13275:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.154@tcp (uuid 221ad158-1cb7-4652-832e-1e3667184cca) 00000020:01000000:2.0:1790895527.294308:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1790895527.294312:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1790895527.294314:0:12643:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf318f09800 for MGC192.168.201.154@tcp 00000020:00000080:2.0:1790895527.294317:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00000080:0.0:1790895527.294324:0:12643:0:(genops.c:885:class_export_put()) final put ffff8cf3077cf000/221ad158-1cb7-4652-832e-1e3667184cca 00000020:00080000:2.0:1790895527.294325:0:13275:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8cf3371f9000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00000080:0.0:1790895527.294329:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3077cf000/221ad158-1cb7-4652-832e-1e3667184cca for MGC192.168.201.154@tcp 00000020:00080000:2.0:1790895527.294334:0:13275:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff8cf3077c4d40) has exports, disconnecting them 00000020:01000000:0.0:1790895527.294336:0:12643:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.154@tcp (221ad158-1cb7-4652-832e-1e3667184cca) 00000020:00080000:2.0:1790895527.294340:0:13275:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8cf3371f9000), last request at 1790895335 00000020:00000080:2.0:1790895527.294345:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf85f3 00000020:00080000:2.0:1790895527.294356:0:13275:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff8cf3371f9000): rc 0 00000020:00000080:2.0:1790895527.294361:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf3371f9000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1790895527.295058:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3371f9000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1790895527.300621:0:13275:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1790895527.300630:0:13275:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1790895527.300635:0:13275:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1790895527.300642:0:13275:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1790895527.300708:0:5820:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1790895527.302596:0:5819:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:3.0:1790895527.305225:0:12643:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff8cf30fc30000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1790895527.361946:0:6704:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1790895527.362097:0:7629:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_002: service thread [ffff8cf336bae000:7629] 2 exiting: rc = 0 00000100:00100000:3.0:1790895527.362196:0:5815:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8cf314e65400:5815] 1 exiting: rc = 0 00000100:00100000:2.0:1790895527.362952:0:5814:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8cf31badb400:5814] 0 exiting: rc = 1 00000100:00100000:3.0:1790895527.363773:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.368155:0:5816:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8cf314811a00:5816] 0 exiting: rc = 1 00000100:00100000:2.0:1790895527.368272:0:5817:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8cf3328ad600:5817] 1 exiting: rc = 0 00000100:00100000:2.0:1790895527.368325:0:5818:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8cf318156800:5818] 2 exiting: rc = 0 00000100:00100000:2.0:1790895527.369895:0:11170:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8cf339699a00:11170] 3 exiting: rc = 0 00000100:00100000:3.0:1790895527.370101:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370109:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370115:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370121:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370127:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370133:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370138:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370144:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370150:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370155:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370160:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370165:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370185:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370191:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370196:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370201:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370207:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370214:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370219:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370224:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370228:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370233:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370239:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370244:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370249:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370254:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370259:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370264:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370269:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370274:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370279:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370283:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370289:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370293:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370298:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370303:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370308:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370313:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370318:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370322:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370327:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370332:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370337:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370342:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370348:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370353:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370357:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370368:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370373:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370378:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370383:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370388:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370393:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370399:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370404:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370410:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370415:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370420:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370426:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370431:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370437:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370442:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370448:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.370452:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1790895527.375348:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1790895527.375365:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1790895527.375372:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf30643f800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1790895527.375377:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf30643f800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1790895527.375383:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1790895527.375446:0:13275:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf332953800 1 00000020:00000080:3.0:1790895527.375452:0:13275:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7911a98710cf8598 00000020:00000080:3.0:1790895527.375458:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf332956800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1790895527.375470:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1790895527.375598:0:12643:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf332956800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1790895527.375611:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1790895527.375617:0:13275:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1790895527.375675:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff8cf3031a99c0) has no exports 00000020:00000080:2.0:1790895527.413396:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790895527.413412:0:13275:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1790895527.413418:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf3371fb800/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1790895527.413423:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3371fb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1790895527.413434:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1790895527.413726:0:13275:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8cf3371fa000 00000020:01000000:2.0:1790895527.413750:0:13275:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1790895527.413754:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1790895527.413758:0:13275:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1790895527.413762:0:13275:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff8cf340fb3380) has no exports 00000020:00000080:2.0:1790895527.413796:0:13275:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1790895527.413802:0:13275:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1790895527.413805:0:13275:0:(genops.c:885:class_export_put()) final put ffff8cf3061ff800/OSS_uuid 00000020:00000080:2.0:1790895527.413807:0:13275:0:(genops.c:844:class_export_destroy()) destroying export ffff8cf3061ff800/OSS_uuid for OSS 00000020:01000000:2.0:1790895527.413814:0:13275:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1790895527.417065:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff8cf303841a00:6690] 1 exiting: rc = 0 00000100:00100000:2.0:1790895527.417174:0:12529:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff8cf33a83d000:12529] 4 exiting: rc = 0 00000100:00080000:0.0:1790895527.418121:0:5827:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1790895527.418254:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff8cf3061d4a00:6691] 2 exiting: rc = 0 00000100:00100000:0.0:1790895527.418295:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff8cf303fbfa00:6688] 0 exiting: rc = 1 00000100:00100000:0.0:1790895527.418332:0:8701:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff8cf30580d800:8701] 3 exiting: rc = 0 00000100:00100000:2.0:1790895527.418939:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.418947:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.418954:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419031:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419040:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419047:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419052:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419115:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419123:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419128:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419134:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419139:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419144:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419149:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419153:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419158:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419163:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419169:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419173:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419177:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419183:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419188:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419193:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419206:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419211:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419215:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419220:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419224:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419229:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419234:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419239:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419243:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419250:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419255:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419260:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419265:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419270:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419275:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419279:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419283:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419288:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419293:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419297:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419302:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419306:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419311:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419315:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419320:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419326:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419331:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419336:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419341:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419345:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419355:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419360:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419364:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419372:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419376:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419387:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419392:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419397:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419403:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419408:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.419413:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.420662:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8cf305908000:6693] 1 exiting: rc = 0 00000100:00100000:2.0:1790895527.421444:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8cf305909a00:6692] 0 exiting: rc = 1 00000100:00100000:2.0:1790895527.421519:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421526:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421531:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421536:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421541:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421546:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421552:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421557:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421562:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421567:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421572:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421577:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421582:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421587:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421593:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421598:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421603:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421608:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421614:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421619:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421624:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421629:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421633:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421638:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421643:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421647:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421653:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421658:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421675:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421680:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421685:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421691:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421697:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421702:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421708:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421713:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421717:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421722:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421727:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421731:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421735:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421740:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421745:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421750:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421755:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421760:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421765:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421770:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421775:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.421780:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424121:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424129:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424134:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424139:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424144:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424149:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424154:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424159:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424164:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424168:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424173:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424178:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424183:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.424208:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790895527.429798:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8cf3076c3a00:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1790895527.430733:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8cf3076c2400:6696] 2 exiting: rc = 0 00000100:00100000:0.0:1790895527.467824:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8cf3076c3400:6695] 1 exiting: rc = 0 00000100:00100000:2.0:1790895527.467958:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.467967:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.467972:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.467978:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468008:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468026:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468033:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468038:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468044:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468049:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468055:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468061:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468066:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468072:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468078:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468083:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468089:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468095:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468101:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468107:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468113:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468118:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468124:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468129:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468135:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468141:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468147:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468152:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468158:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468177:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468184:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468190:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468195:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468216:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468221:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468227:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468232:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468237:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468243:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468248:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468253:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468259:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468265:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468271:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468277:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468284:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468290:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468296:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468302:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468307:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468311:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468317:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468323:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468329:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468334:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468342:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468361:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468369:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468387:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468394:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468399:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468404:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468409:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.468415:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1790895527.476221:0:6698:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8cf3076c3e00:6698] 1 exiting: rc = 0 00000100:00100000:0.0:1790895527.476221:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8cf3076c3c00:6697] 0 exiting: rc = 1 00000100:00100000:2.0:1790895527.476411:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476418:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476424:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476429:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476449:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476455:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476460:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476466:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476471:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476476:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476482:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476487:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476491:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476497:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476502:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476508:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476513:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476518:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476524:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476529:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476534:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476539:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476544:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476549:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476554:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476559:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476564:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476569:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476573:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476576:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476579:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476582:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476586:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476589:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476592:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476595:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476598:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476601:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476604:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476613:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476616:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476620:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476625:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476630:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476635:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476640:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476645:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476649:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476655:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476660:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476666:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476669:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476673:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476676:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476680:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476682:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476685:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476689:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476692:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476695:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476698:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476701:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476704:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.476708:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1790895527.481945:0:6699:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8cf3076c2800:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1790895527.489348:0:6700:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8cf3076c2e00:6700] 1 exiting: rc = 0 00000100:00100000:2.0:1790895527.489442:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489450:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489466:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489487:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489494:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489501:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489507:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489512:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489518:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489524:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489538:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489545:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489554:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489560:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489566:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489586:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489592:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489598:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489604:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489609:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489614:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489623:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489631:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489637:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489643:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489648:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489654:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489674:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489681:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489687:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489695:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489701:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489706:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489712:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489719:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489724:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489729:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489735:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489741:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489761:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489767:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489773:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489779:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489785:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489790:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489803:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489809:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489815:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489820:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489826:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489832:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489853:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489922:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489928:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489934:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489940:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489946:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489952:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489958:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489965:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489971:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489977:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489982:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1790895527.489996:0:13275:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1790895527.497658:0:13275:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1790895543.456468:0:13888:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1790895552.233602:0:14349:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790895552.233608:0:14349:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1790895552.233761:0:14349:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cf336887800 00000020:01000004:3.0:1790895552.233775:0:14349:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1790895552.233781:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1790895552.233792:0:14349:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8cf30650cd40) 00000020:00000080:3.0:1790895552.233806:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1790895552.247626:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1790895552.249715:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1790895552.250263:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 367: rc = 0 00100000:10000000:3.0:1790895552.250366:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 367: rc = 0 00100000:10000000:3.0:1790895552.250463:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 367: rc = 0 00100000:10000000:3.0:1790895552.250664:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1790895552.250734:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 367: rc = 0 00100000:10000000:3.0:1790895552.251133:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 367: rc = 0 00100000:10000000:3.0:1790895552.251238:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 367: rc = 0 00100000:10000000:3.0:1790895552.251482:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 369: rc = 0 00100000:10000000:3.0:1790895552.252678:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 371: rc = 0 00100000:10000000:3.0:1790895552.252772:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 371: rc = 0 00100000:10000000:3.0:1790895552.253386:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 247: rc = 0 00100000:10000000:3.0:1790895552.253640:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 247: rc = 0 00100000:10000000:3.0:1790895552.253994:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 247: rc = 0 00100000:10000000:3.0:1790895552.254381:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 247: rc = 0 00100000:10000000:3.0:1790895552.254639:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 247: rc = 0 00100000:10000000:3.0:1790895552.254973:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 247: rc = 0 00100000:10000000:3.0:1790895552.255353:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 247: rc = 0 00100000:10000000:3.0:1790895552.256152:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 247: rc = 0 00100000:10000000:3.0:1790895552.256554:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 247: rc = 0 00100000:10000000:3.0:1790895552.256813:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 247: rc = 0 00100000:10000000:3.0:1790895552.257194:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 247: rc = 0 00100000:10000000:3.0:1790895552.257416:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 247: rc = 0 00100000:10000000:3.0:1790895552.257789:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 634: rc = 0 00100000:10000000:3.0:1790895552.258242:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 634: rc = 0 00100000:10000000:3.0:1790895552.258483:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 634: rc = 0 00100000:10000000:3.0:1790895552.258743:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 634: rc = 0 00100000:10000000:3.0:1790895552.259370:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 634: rc = 0 00100000:10000000:3.0:1790895552.259644:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 634: rc = 0 00100000:10000000:3.0:1790895552.259991:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 634: rc = 0 00100000:10000000:3.0:1790895552.260364:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 634: rc = 0 00100000:10000000:3.0:1790895552.260625:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 634: rc = 0 00100000:10000000:3.0:1790895552.260908:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 634: rc = 0 00100000:10000000:3.0:1790895552.261237:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 634: rc = 0 00100000:10000000:3.0:1790895552.261462:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 634: rc = 0 00100000:10000000:3.0:1790895552.261691:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 634: rc = 0 00100000:10000000:3.0:1790895552.262152:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 634: rc = 0 00100000:10000000:3.0:1790895552.262385:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 634: rc = 0 00100000:10000000:3.0:1790895552.262614:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 634: rc = 0 00100000:10000000:3.0:1790895552.262835:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 634: rc = 0 00100000:10000000:3.0:1790895552.263280:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 634: rc = 0 00100000:10000000:3.0:1790895552.264170:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 634: rc = 0 00100000:10000000:3.0:1790895552.264598:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 634: rc = 0 00100000:10000000:3.0:1790895552.264830:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 634: rc = 0 00100000:10000000:3.0:1790895552.265207:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 634: rc = 0 00100000:10000000:3.0:1790895552.265418:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 634: rc = 0 00100000:10000000:3.0:1790895552.265681:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 634: rc = 0 00100000:10000000:3.0:1790895552.266152:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 634: rc = 0 00100000:10000000:3.0:1790895552.266489:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 634: rc = 0 00100000:10000000:3.0:1790895552.266757:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 634: rc = 0 00100000:10000000:3.0:1790895552.267115:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 634: rc = 0 00100000:10000000:3.0:1790895552.267310:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 634: rc = 0 00100000:10000000:3.0:1790895552.267552:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 634: rc = 0 00100000:10000000:3.0:1790895552.267798:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 634: rc = 0 00100000:10000000:3.0:1790895552.268141:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 634: rc = 0 00100000:10000000:3.0:1790895552.268412:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 377: rc = 0 00100000:10000000:3.0:1790895552.268932:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1790895552.269227:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 372: rc = 0 00100000:10000000:3.0:1790895552.269415:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1790895552.269479:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 372: rc = 0 00100000:10000000:3.0:1790895552.269814:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1790895552.269954:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 372: rc = 0 00100000:10000000:3.0:1790895552.270374:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1790895552.270445:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 624: rc = 0 00100000:10000000:3.0:1790895552.270631:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1790895552.270693:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 624: rc = 0 00100000:10000000:3.0:1790895552.270967:0:14349:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1790895552.271114:0:14349:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 624: rc = 0 00000020:00000080:3.0:1790895552.271368:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1790895552.271376:0:14349:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1790895552.271385:0:14349:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf96af 00000020:01000004:3.0:1790895552.271392:0:14349:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1790895552.271397:0:14349:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1790895552.271407:0:14349:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf336887800 from MGS 00000020:01000004:3.0:1790895552.271411:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1790895552.271420:0:14349:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8cf306508000) 00000020:00000080:3.0:1790895552.271430:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1790895552.271480:0:14349:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf336887800 from MGS, refs=2 00080000:01000000:3.0:1790895552.271484:0:14349:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790895552.271488:0:14349:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf96bd 00000100:00100000:3.0:1790895552.271589:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1790895552.271711:0:14349:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1790895552.271717:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1790895552.272298:0:14349:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1790895552.272305:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1790895552.273144:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.273308:0:14349:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1790895552.273314:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1790895552.273756:0:14349:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1790895552.273763:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1790895552.274254:0:14349:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1790895552.274260:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1790895552.274924:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895552.274927:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895552.274929:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895552.275352:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895552.275354:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895552.275356:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895552.275917:0:14349:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1790895552.278105:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1790895552.285645:0:14349:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1790895552.285664:0:14349:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1790895552.285667:0:14349:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1790895552.287179:0:14358:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790895552.287318:0:14349:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790895552.287409:0:14349:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790895552.287886:0:14349:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790895552.288263:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.288415:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790895552.288422:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1790895552.297111:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1790895552.297127:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1790895552.299606:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1790895552.299619:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1790895552.300250:0:14363:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1790895552.300599:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1790895552.300620:0:14349:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.154@tcp' 00000020:01000004:3.0:1790895552.300622:0:14349:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1790895552.300651:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.154@tcp (typ=mgc) 00000020:00000080:3.0:1790895552.300663:0:14349:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.154@tcp (ffff8cf30650b380) 00000020:00000080:3.0:1790895552.300679:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1790895552.300754:0:14349:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf336886000@MGC192.168.201.154@tcp: add connection 192.168.201.154@tcp at head 00010000:00010000:3.0:1790895552.301060:0:14349:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.154@tcp-0 is initialized 00000040:01000000:3.0:1790895552.301067:0:14349:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 1 is initialized 10000000:01000000:0.0:1790895552.303665:0:14364:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1790895552.303913:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.154@tcp (uuid 38adfb21-dafb-4eb3-8476-02ed33ee7efa) 00000020:00000080:3.0:1790895552.303935:0:14349:0:(genops.c:1384:class_connect()) connect: client 38adfb21-dafb-4eb3-8476-02ed33ee7efa, cookie 0x7911a98710cf96cb 00000100:00080000:3.0:1790895552.303948:0:14349:0:(import.c:545:import_select_connection()) MGC192.168.201.154@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790895552.303959:0:14349:0:(import.c:666:import_select_connection()) MGC192.168.201.154@tcp: import ffff8cf336886000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:3.0:1790895552.303990:0:14349:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf336e35500 x1877889758873472/t0(0) o250->MGC192.168.201.154@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790895552.304020:0:14349:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 38adfb21-dafb-4eb3-8476-02ed33ee7efa->MGS 00000020:01000004:3.0:1790895552.304047:0:14349:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1790895552.304052:0:14349:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1790895552.304065:0:14349:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8cf3065099c0) 00000020:00000080:3.0:1790895552.304077:0:14349:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1790895552.304526:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3307:1877889758873472:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1790895552.304597:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895552.304914:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758873472 00000100:00100000:0.0:1790895552.304925:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758873472 00000100:00100000:0.0:1790895552.304960:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895552.304967:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3307:x1877889758873472:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1790895552.304992:0:14359:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 38adfb21-dafb-4eb3-8476-02ed33ee7efa@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:0.0:1790895552.305262:0:14359:0:(genops.c:1384:class_connect()) connect: client 38adfb21-dafb-4eb3-8476-02ed33ee7efa, cookie 0x7911a98710cf96d9 00000100:00080000:0.0:1790895552.305393:0:14359:0:(import.c:65:import_set_state_nolock()) ffff8cf339194000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895552.305460:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+5:3307:x1877889758873472:12345-0@lo:250:mount.lustre.0 Request processed in 492us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.305467:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895552.305496:0:3307:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.154@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1790895552.305505:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.201.154@tcp: connect to target with instance 0 00000100:00080000:1.0:1790895552.305512:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.201.154@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1790895552.305516:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1790895552.305520:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf336886000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1790895552.305522:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1790895552.305533:0:3307:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1790895552.305538:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3307:1877889758873472:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1790895552.324106:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.324293:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1790895552.324299:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1790895552.326204:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1790895552.326215:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1790895552.326986:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1790895552.326994:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1790895552.327937:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.328103:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1790895552.328110:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1790895552.329097:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1790895552.329105:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1790895552.367691:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895552.368016:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1790895552.368022:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1790895552.368754:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1790895552.369017:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1790895552.369577:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.369734:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790895552.369740:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1790895552.370592:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790895552.370600:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1790895552.371279:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.371556:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790895552.371572:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1790895552.372155:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790895552.372160:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1790895552.372702:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.373016:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1790895552.373021:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1790895552.373443:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1790895552.373450:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1790895552.387807:0:14349:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790895552.388116:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1790895552.388122:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1790895552.392295:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1790895552.392312:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1790895552.393243:0:14349:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1790895552.393253:0:14349:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1790895552.394417:0:14349:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1790895552.394440:0:14349:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1790895552.394445:0:14349:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1790895552.394575:0:14349:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:3.0:1790895552.394613:0:14349:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.154@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1790895552.394617:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1790895552.394619:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790895552.394620:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790895552.394621:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790895552.394622:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790895552.394623:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790895552.394625:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790895552.394626:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790895552.394628:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790895552.394629:0:14349:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790895552.394631:0:14349:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1790895552.394633:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790895552.394634:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790895552.394635:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790895552.394640:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790895552.394641:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790895552.394642:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790895552.394643:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790895552.394644:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790895552.394645:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790895552.394645:0:14349:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1790895552.394671:0:14349:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790895552.394689:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873600:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790895552.394750:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.395009:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf32a5f2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1790895552.395182:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758873600 00000100:00100000:0.0:1790895552.395189:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758873600 00000100:00100000:0.0:1790895552.395257:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790895552.395270:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+5:14349:x1877889758873600:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790895552.395300:0:14362:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1790895552.395301:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1790895552.395312:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1790895552.395572:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1790895552.395842:0:14362:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1790895552.396709:0:14384:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1790895552.396713:0:14384:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1790895552.396714:0:14384:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1790895552.396733:0:14384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1790895552.396948:0:14362:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1790895552.396957:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790895552.400611:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+5:14349:x1877889758873600:12345-0@lo:253:mount.lustre.0 Request processed in 5335us (5853us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895552.400611:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873600:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790895552.400629:0:14349:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000100:00100000:3.0:1790895552.400630:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000004:1.0:1790895552.400632:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790895552.400633:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1790895552.400634:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895552.400636:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790895552.400637:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895552.400638:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895552.400639:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1790895552.400640:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1790895552.400642:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895552.400643:0:14349:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1790895552.400660:0:14349:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf336887800 from lustre-MDT0000 10000000:01000000:1.0:1790895552.400700:0:14349:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1790895552.400703:0:14349:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1790895552.400707:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8cf30650b380 10000000:01000000:1.0:1790895552.400711:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1790895552.400719:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8cf30650b380 from 1 10000000:01000000:1.0:1790895552.400722:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1790895552.400755:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.400895:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.400907:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895552.400929:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790895552.400963:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.401031:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:0.0:1790895552.401111:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758873728 00000100:00100000:0.0:1790895552.401118:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758873728 00000100:00100000:0.0:1790895552.401150:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895552.401159:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+5:14349:x1877889758873728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790895552.401170:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895552.401183:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7c400/0x7911a98710cf96e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf96e0 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.401205:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7c400/0x7911a98710cf96e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf96e0 expref: 6 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.401214:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7c400/0x7911a98710cf96e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf96e0 expref: 6 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.401222:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c400, rc 0) 00000100:00100000:0.0:1790895552.401258:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+6:14349:x1877889758873728:12345-0@lo:101:mount.lustre.0 Request processed in 100us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.401264:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790895552.401283:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790895552.401297:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.401305:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895552.401348:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895552.401374:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.401395:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790895552.401417:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758873856 00000100:00100000:3.0:1790895552.401422:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758873856 00000100:00100000:3.0:1790895552.401446:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790895552.401452:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+6:14349:x1877889758873856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895552.401648:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+6:14349:x1877889758873856:12345-0@lo:501:mount.lustre.0 Request processed in 195us (272us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790895552.401655:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1790895552.401675:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1790895552.401705:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1790895552.401719:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.401728:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895552.401735:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf336887800 10000000:01000000:1.0:1790895552.401740:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1790895552.401743:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8cf336887800 10000000:01000000:1.0:1790895552.401746:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1790895552.401749:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8cf336887800 from 1 10000000:01000000:1.0:1790895552.401751:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1790895552.401765:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d200/0x7911a98710cf96ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.401772:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d200/0x7911a98710cf96ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.401780:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d200/0x7911a98710cf96ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895552.401791:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790895552.401814:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.401836:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:0.0:1790895552.401903:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758873984 00000100:00100000:0.0:1790895552.401907:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758873984 00000100:00100000:0.0:1790895552.401933:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790895552.401946:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+6:14349:x1877889758873984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790895552.401954:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895552.401963:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7d200/0x7911a98710cf96f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf96ee expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.401976:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7d200/0x7911a98710cf96f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf96ee expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.401984:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7d200/0x7911a98710cf96f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf96ee expref: 7 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.401990:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d200, rc 0) 00000100:00100000:0.0:1790895552.402025:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+7:14349:x1877889758873984:12345-0@lo:101:mount.lustre.0 Request processed in 79us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.402030:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1790895552.402155:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758873984:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895552.402165:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d200/0x7911a98710cf96ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96f5 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.402172:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d200/0x7911a98710cf96ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf96f5 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895552.402182:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1790895552.402224:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d200/0x7911a98710cf96ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96f5 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.402238:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d200/0x7911a98710cf96ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96f5 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895552.402244:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1790895552.402248:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790895552.402252:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8cf336887800 10000000:01000000:3.0:1790895552.402255:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1790895552.402257:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1790895552.402260:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1790895552.402274:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf96fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.402281:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf96fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.402287:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf96fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895552.402299:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758874112:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790895552.402329:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.402353:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf32a5f2900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.402377:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758874112 00000100:00100000:2.0:1790895552.402381:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758874112 00000100:00100000:2.0:1790895552.402415:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790895552.402422:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+7:14349:x1877889758874112:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895552.402437:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895552.402446:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84e600/0x7911a98710cf9703 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf96fc expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.402460:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84e600/0x7911a98710cf9703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf96fc expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.402468:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84e600/0x7911a98710cf9703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf96fc expref: 8 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.402474:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e600, rc 0) 00000100:00100000:2.0:1790895552.402512:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+8:14349:x1877889758874112:12345-0@lo:101:mount.lustre.0 Request processed in 91us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.402518:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790895552.402547:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758874112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895552.402557:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf96fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9703 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.402577:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf96fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9703 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895552.402618:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758874240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895552.402634:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.402649:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf32a5f2900 going to sleep for 11 seconds 00000100:00100000:1.0:1790895552.402671:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758874240 00000100:00100000:1.0:1790895552.402675:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758874240 00000100:00100000:1.0:1790895552.402704:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790895552.402711:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+8:14349:x1877889758874240:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790895552.403186:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14349:x1877889758874240:12345-0@lo:501:mount.lustre.0 Request processed in 474us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.403193:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790895552.403238:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758874240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895552.403264:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758874368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895552.403296:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.403408:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf32a5f2900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.403435:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758874368 00000100:00100000:2.0:1790895552.403439:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758874368 00000100:00100000:2.0:1790895552.403481:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895552.403487:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14349:x1877889758874368:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790895552.403735:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14349:x1877889758874368:12345-0@lo:503:mount.lustre.0 Request processed in 247us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.403741:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790895552.403763:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758874368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895552.404446:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14385:1877889758874496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895552.404478:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.404536:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf32a5f2e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790895552.404573:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758874496 00000100:00100000:0.0:1790895552.404577:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758874496 00000100:00100000:0.0:1790895552.404628:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790895552.404635:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14385:x1877889758874496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895552.404963:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14385:1877889758874496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895552.404963:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14385:x1877889758874496:12345-0@lo:502:llog_process_th.0 Request processed in 327us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.404970:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000020:01000000:2.0:1790895552.404988:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895552.405099:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895552.405103:0:14385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790895552.405109:0:14385:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1790895552.405112:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790895552.405126:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8cf203044d40) 00000020:00000080:2.0:1790895552.405149:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1790895552.405155:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1790895552.405289:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1790895552.405296:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf9711 00000020:00000080:2.0:1790895552.405465:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1790895552.405469:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895552.405472:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895552.405473:0:14385:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1790895552.405475:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895552.405477:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895552.405478:0:14385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1790895552.405480:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790895552.405485:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8cf203043380) 00000020:00000080:2.0:1790895552.405491:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1790895552.405493:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1790895552.405495:0:14385:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1790895552.405496:0:14385:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1790895552.405500:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790895552.405529:0:14385:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf336887800 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1790895552.405536:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8cf203040000) 00000020:00000080:2.0:1790895552.405541:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1790895552.405597:0:14385:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1790895552.405603:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf9726 00000020:00000080:2.0:1790895552.405693:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1790895552.405699:0:14385:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1790895552.405704:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7911a98710cf972d 00080000:01000000:2.0:1790895552.405708:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1790895552.405710:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf9734 00010000:00010000:3.0:1790895552.454751:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1790895552.455444:0:14385:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:3.0:1790895552.455642:0:14385:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1790895552.456407:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8cf3031a99c0) 00000020:00000080:3.0:1790895552.456428:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1790895552.456511:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1790895552.456519:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf9742 00000020:00000080:0.0:1790895552.457711:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1790895552.465236:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7911a98710cf9749 00000020:00000080:0.0:1790895552.465769:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1790895552.465788:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790895552.465794:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.465796:0:14385:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1790895552.465799:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1790895552.465805:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.465806:0:14385:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1790895552.465810:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1790895552.465844:0:14385:0:(mdt_lproc.c:338:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1790895552.466072:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790895552.466077:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.466078:0:14385:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1790895552.466081:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790895552.466083:0:14385:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1790895552.466084:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790895552.466086:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790895552.466087:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790895552.466089:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.466091:0:14385:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790895552.466093:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790895552.466097:0:14385:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790895552.466100:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.466102:0:14385:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1790895552.466105:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790895552.466111:0:14385:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.154@tcp to nid 0x20000c0a8c99a (192.168.201.154@tcp) 00000020:01000000:0.0:1790895552.466136:0:14385:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790895552.466140:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790895552.466155:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8cf340fb0000) 00000020:00000080:0.0:1790895552.466169:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1790895552.466174:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790895552.466228:0:14385:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1790895552.466233:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:0.0:1790895552.466240:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf9757 00010000:00080000:0.0:1790895552.466270:0:14385:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf3368a1000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:0.0:1790895552.466505:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1790895552.468104:0:14385:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790895552.468181:0:14385:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790895552.469296:0:14385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790895552.469358:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1790895552.469430:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1790895552.470443:0:14389:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790895552.470449:0:14389:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1790895552.471297:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1790895552.471310:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1790895552.471341:0:14385:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1790895552.471359:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf975e 00000100:00080000:0.0:1790895552.471371:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1790895552.471382:0:14385:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf3368a1000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:0.0:1790895552.471415:0:14385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf318e36300 x1877889758874624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790895552.471478:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758874624:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790895552.471531:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877889758874624 offset 0 length 520: 4 00000100:00080000:0.0:1790895552.471646:0:14385:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1790895552.471723:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1790895552.471728:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.471730:0:14385:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1790895552.471733:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1790895552.471735:0:14385:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1790895552.471737:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790895552.471738:0:14385:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1790895552.471740:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1790895552.471742:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.471743:0:14385:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1790895552.471745:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1790895552.471749:0:14385:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1790895552.471752:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1790895552.471753:0:14385:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1790895552.471756:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1790895552.471760:0:14385:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.154@tcp to nid 0x20000c0a8c99a (192.168.201.154@tcp) 00000020:01000000:0.0:1790895552.471780:0:14385:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1790895552.471789:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1790895552.471799:0:14385:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8cf340fb19c0) 00000020:00000080:0.0:1790895552.471812:0:14385:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1790895552.471817:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1790895552.471919:0:14385:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1790895552.471926:0:14385:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1790895552.471932:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7911a98710cf976c 00010000:00080000:0.0:1790895552.471959:0:14385:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf340fc7000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:0.0:1790895552.472284:0:14385:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:0.0:1790895552.472479:0:14385:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1790895552.472503:0:14385:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1790895552.473102:0:14385:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790895552.473166:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:0.0:1790895552.473253:0:14385:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1790895552.475391:0:14391:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1790895552.475399:0:14391:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1790895552.476937:0:14385:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790895552.476953:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790895552.477070:0:14385:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1790895552.477094:0:14385:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf9773 00000100:00080000:3.0:1790895552.477105:0:14385:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790895552.477122:0:14385:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf340fc7000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:3.0:1790895552.477158:0:14385:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf336e34e00 x1877889758874752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1790895552.477218:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758874752:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1790895552.477282:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877889758874752 offset 0 length 520: 4 00000100:00080000:3.0:1790895552.477335:0:14385:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1790895552.477396:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895552.477400:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895552.477402:0:14385:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1790895552.477405:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895552.477409:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895552.477411:0:14385:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790895552.477414:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790895552.477415:0:14385:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790895552.477418:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895552.477420:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895552.477422:0:14385:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790895552.477425:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895552.477427:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895552.477428:0:14385:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790895552.477431:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1790895552.477460:0:14385:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14385:1877889758874880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895552.477507:0:14385:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.477524:0:14385:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.477595:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758874880 00000100:00100000:2.0:1790895552.477602:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758874880 00000100:00100000:2.0:1790895552.477646:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790895552.477655:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14385:x1877889758874880:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895552.477907:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14385:x1877889758874880:12345-0@lo:502:llog_process_th.0 Request processed in 252us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.477921:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790895552.477968:0:14385:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14385:1877889758874880:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1790895552.477991:0:14385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895552.478069:0:14385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895552.478071:0:14385:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790895552.478076:0:14385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1790895552.478314:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1790895552.478336:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1790895552.478386:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf96fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9703 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.478399:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf30167ce00/0x7911a98710cf96fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9703 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895552.478408:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf336887800 from 1 10000000:01000000:1.0:1790895552.478411:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790895552.478441:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.478449:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.478458:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895552.478472:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875008:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790895552.478503:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.478534:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.478589:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875008 00000100:00100000:2.0:1790895552.478595:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875008 00000100:00100000:2.0:1790895552.478626:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790895552.478634:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+9:14349:x1877889758875008:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895552.478644:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895552.478657:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf977a expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.478678:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf977a expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.478689:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf977a expref: 10 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.478697:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84e400, rc 0) 00000100:00100000:2.0:1790895552.478736:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+10:14349:x1877889758875008:12345-0@lo:101:mount.lustre.0 Request processed in 103us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.478742:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790895552.478806:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790895552.478827:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.478836:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895552.479537:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875136:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1790895552.479589:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.479610:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.479677:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875136 00000100:00100000:2.0:1790895552.479683:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875136 00000100:00100000:2.0:1790895552.479706:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790895552.479713:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+10:14349:x1877889758875136:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1790895552.479734:0:14361:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1790895552.479740:0:14361:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1790895552.479809:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+10:14349:x1877889758875136:12345-0@lo:256:mount.lustre.0 Request processed in 96us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.479815:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790895552.480189:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875136:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1790895552.480738:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790895552.480760:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.480771:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895552.480780:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf336887800 from 1 10000000:01000000:1.0:1790895552.480782:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790895552.480810:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.480818:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.480827:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895552.480842:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875264:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1790895552.480921:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.480955:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790895552.481150:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875264 00000100:00100000:3.0:1790895552.481157:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875264 00000100:00100000:3.0:1790895552.481201:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790895552.481209:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+10:14349:x1877889758875264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895552.481220:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895552.481235:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9788 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.481266:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9788 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.481274:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9788 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.481282:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895552.481322:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14349:x1877889758875264:12345-0@lo:101:mount.lustre.0 Request processed in 115us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895552.481329:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790895552.481418:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875264:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790895552.481432:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.481441:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895552.481489:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895552.481513:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.481542:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:3.0:1790895552.481588:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875392 00000100:00100000:3.0:1790895552.481592:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875392 00000100:00100000:3.0:1790895552.481623:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790895552.481630:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14349:x1877889758875392:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895552.482257:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14349:x1877889758875392:12345-0@lo:501:mount.lustre.0 Request processed in 626us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895552.482265:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790895552.482374:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875392:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895552.482406:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790895552.482446:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.482508:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b540 going to sleep for 11 seconds 00000100:00100000:0.0:1790895552.482541:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875520 00000100:00100000:0.0:1790895552.482547:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875520 00000100:00100000:0.0:1790895552.482621:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790895552.482632:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14349:x1877889758875520:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790895552.482787:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14349:x1877889758875520:12345-0@lo:503:mount.lustre.0 Request processed in 157us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.482794:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790895552.482895:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875520:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790895552.483279:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14393:1877889758875648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895552.483313:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.483460:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf307d62e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895552.483524:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875648 00000100:00100000:3.0:1790895552.483530:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875648 00000100:00100000:3.0:1790895552.483554:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790895552.483573:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14393:x1877889758875648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895552.483772:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14393:x1877889758875648:12345-0@lo:502:llog_process_th.0 Request processed in 200us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895552.483779:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790895552.483847:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14393:1877889758875648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790895552.483894:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895552.483903:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895552.483906:0:14393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790895552.483912:0:14393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf336887800 00000020:00000080:1.0:1790895552.483919:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790895552.483927:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895552.483930:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895552.483931:0:14393:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790895552.483934:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895552.483936:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895552.483937:0:14393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790895552.483941:0:14393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf336887800 00000020:00000080:1.0:1790895552.483943:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790895552.485144:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895552.485152:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895552.485154:0:14393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790895552.485156:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895552.485160:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895552.485161:0:14393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790895552.485167:0:14393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf336887800 00000020:00000080:1.0:1790895552.485169:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1790895552.485226:0:14393:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14393:1877889758875776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1790895552.485281:0:14393:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895552.485320:0:14393:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf307d62e40 going to sleep for 11 seconds 00000100:00100000:0.0:1790895552.489605:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875776 00000100:00100000:0.0:1790895552.489622:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875776 00000100:00100000:0.0:1790895552.489677:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790895552.489686:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14393:x1877889758875776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1790895552.489963:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14393:x1877889758875776:12345-0@lo:502:llog_process_th.0 Request processed in 277us (4681us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.489978:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1790895552.490121:0:14393:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14393:1877889758875776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1790895552.490156:0:14393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895552.490163:0:14393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895552.490166:0:14393:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790895552.490170:0:14393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1790895552.494254:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790895552.494285:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895552.494310:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.494322:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895552.494370:0:14349:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790895552.494373:0:14349:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf336887800 10000000:01000000:2.0:1790895552.494376:0:14349:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf336887800 10000000:01000000:2.0:1790895552.494379:0:14349:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790895552.494384:0:14349:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf336887800 from 1 10000000:01000000:2.0:1790895552.494387:0:14349:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790895552.494423:0:14349:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fe00/0x7911a98710cf9796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.494431:0:14349:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fe00/0x7911a98710cf9796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.494441:0:14349:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fe00/0x7911a98710cf9796 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895552.494465:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790895552.494543:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895552.494597:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf32a5f2900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.494617:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758875904 00000100:00100000:2.0:1790895552.494624:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758875904 00000100:00100000:2.0:1790895552.494669:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790895552.494678:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14349:x1877889758875904:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895552.494693:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895552.494706:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84ec00/0x7911a98710cf979d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9796 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.494731:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84ec00/0x7911a98710cf979d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9796 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.494743:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84ec00/0x7911a98710cf979d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9796 expref: 12 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.494753:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84ec00, rc 0) 00000100:00100000:2.0:1790895552.494794:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14349:x1877889758875904:12345-0@lo:101:mount.lustre.0 Request processed in 117us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.494802:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790895552.494846:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758875904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895552.494889:0:14349:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fe00/0x7911a98710cf9796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf979d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.494899:0:14349:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fe00/0x7911a98710cf9796 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf979d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895552.494947:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758876032:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790895552.494979:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895552.494987:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf32a5f2900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.495135:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876032 00000100:00100000:2.0:1790895552.495140:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876032 00000100:00100000:2.0:1790895552.495159:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790895552.495165:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14349:x1877889758876032:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790895552.497118:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14349:x1877889758876032:12345-0@lo:501:mount.lustre.0 Request processed in 1946us (2132us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.497130:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790895552.499944:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758876032:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895552.500139:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758876160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895552.500210:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.500250:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895552.500284:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876160 00000100:00100000:3.0:1790895552.500290:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876160 00000100:00100000:3.0:1790895552.500372:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790895552.500382:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14349:x1877889758876160:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895552.500583:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14349:x1877889758876160:12345-0@lo:503:mount.lustre.0 Request processed in 202us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895552.500590:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1790895552.507461:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758876160:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895552.512284:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14399:1877889758876288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895552.512371:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.512414:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895552.512460:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876288 00000100:00100000:2.0:1790895552.512468:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876288 00000100:00100000:2.0:1790895552.512515:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1790895552.512524:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14399:x1877889758876288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1790895552.512782:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14399:x1877889758876288:12345-0@lo:502:llog_process_th.0 Request processed in 258us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895552.512790:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790895552.513131:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14399:1877889758876288:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1790895552.513194:0:14399:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790895552.513208:0:14399:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8cf3031ab380) 00000020:00000080:3.0:1790895552.513226:0:14399:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1790895552.513299:0:14399:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf336887800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790895552.513303:0:14399:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf336887800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790895552.513305:0:14399:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf336887800 4 00010000:00080000:3.0:1790895552.513334:0:14399:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf338c5e000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.154@tcp at head 00010000:00010000:3.0:1790895552.515574:0:14399:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1790895552.515770:0:14399:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790895552.515806:0:14399:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790895552.515825:0:14399:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7911a98710cf97ab 00000100:00080000:3.0:1790895552.515837:0:14399:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790895552.515848:0:14399:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cf338c5e000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:3.0:1790895552.515911:0:14399:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf336e35500 x1877889758876416/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790895552.515933:0:14399:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1790895552.516472:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758876416:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1790895552.516551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.517771:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876416 00000100:00100000:3.0:1790895552.517783:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876416 00000100:00100000:3.0:1790895552.517815:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790895552.517823:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1877889758876416:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790895552.517926:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1877889758876416:12345-0@lo:38:llog_process_th.0 Request processed in 102us (1373us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790895552.517933:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895552.518242:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1790895552.518251:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf338c5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790895552.518255:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1790895552.518265:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758876416:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1790895552.518411:0:14399:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14399:1877889758876544:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895552.518455:0:14399:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.518478:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876544 00000100:00100000:3.0:1790895552.518482:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876544 00000100:00100000:3.0:1790895552.518548:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790895552.518556:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14399:x1877889758876544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1790895552.518803:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14399:x1877889758876544:12345-0@lo:502:llog_process_th.0 Request processed in 247us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895552.518810:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1790895552.523527:0:14399:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895552.523580:0:14399:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e36a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14399:1877889758876544:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1790895552.523624:0:14399:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1790895552.523689:0:14349:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790895552.523714:0:14349:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790895552.523777:0:14349:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fe00/0x7911a98710cf9796 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf979d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895552.523789:0:14349:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f84fe00/0x7911a98710cf9796 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf979d expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790895552.523840:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790895552.523843:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790895552.523844:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790895552.523846:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790895552.523847:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790895552.523848:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790895552.523850:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790895552.523852:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790895552.523854:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790895552.523885:0:14349:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790895552.523889:0:14349:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790895552.523892:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790895552.523893:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790895552.523895:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790895552.523896:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790895552.523897:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790895552.523898:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790895552.523899:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790895552.523900:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790895552.523901:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790895552.523902:0:14349:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790895552.523925:0:14349:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790895552.523943:0:14349:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758876672:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790895552.524080:0:14349:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895552.524108:0:14349:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895552.524401:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876672 00000100:00100000:0.0:1790895552.524409:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876672 00000100:00100000:0.0:1790895552.524459:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1790895552.524468:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14349:x1877889758876672:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790895552.524492:0:14359:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790895552.524507:0:14359:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790895552.558534:0:14359:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790895552.558555:0:14359:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1790895552.558623:0:14383:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1790895552.558628:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1790895552.558650:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.558668:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf977a expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.558677:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.558717:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf977a expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895552.558745:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf977a expref: 12 pid: 14359 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895552.558761:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1877889758876800:0@lo:104: 00000100:00100000:2.0:1790895552.558823:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895552.558888:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3187900c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895552.559096:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876800 00000100:00100000:1.0:1790895552.559104:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876800 00000100:00100000:1.0:1790895552.559153:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895552.559163:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14383:x1877889758876800:12345-0@lo:104: 00010000:00010000:1.0:1790895552.559175:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895552.559227:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790895552.559233:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14383:x1877889758876800:12345-0@lo:104: Request processed in 73us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895552.559241:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895552.559278:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1877889758876800:0@lo:104: 00010000:00010000:1.0:1790895552.559294:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559490:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895552.559497:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559506:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c600 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895552.559510:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559518:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895552.559527:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895552.559532:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790895552.559578:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559584:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790895552.559611:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559618:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf33f91c600/0x7911a98710cf977a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9781 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559642:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895552.559644:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895552.559645:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895552.559665:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790895552.559674:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3311:1877889758876928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895552.559703:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895552.559746:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758876928 00000100:00100000:0.0:1790895552.559750:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758876928 00010000:00010000:0.0:1790895552.559766:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf977a expref: 13 pid: 14359 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895552.559785:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895552.559791:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+13:3311:x1877889758876928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895552.559800:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895552.559805:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf977a expref: 13 pid: 14359 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559815:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf977a expref: 13 pid: 14359 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559827:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84e400/0x7911a98710cf9781 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf977a expref: 13 pid: 14359 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559839:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559846:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790895552.559900:0:14352:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001272221s 00010000:00010000:0.0:1790895552.559904:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559912:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559918:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559924:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559929:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ee00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895552.559932:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559939:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559953:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.559962:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895552.559988:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:3311:x1877889758876928:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.559995:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895552.560023:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3311:1877889758876928:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895552.560037:0:14383:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.560169:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895552.560175:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84ee00/0x7911a98710cf97b2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895552.568671:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14349:x1877889758876672:12345-0@lo:253:mount.lustre.0 Request processed in 44197us (44584us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895552.569007:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1790895552.569216:0:14349:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e36a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14349:1877889758876672:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1790895552.569233:0:14349:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790895552.569236:0:14349:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790895552.569252:0:14349:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790895552.569253:0:14349:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790895552.569254:0:14349:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790895552.569327:0:14349:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790895552.569329:0:14349:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790895552.569331:0:14349:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790895552.569332:0:14349:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790895552.569335:0:14349:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790895552.569336:0:14349:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790895552.569353:0:14349:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1790895552.573923:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895552.574164:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1790895552.574523:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895552.574683:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1790895552.574978:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895552.575196:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790895552.576125:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895552.576336:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790895552.576599:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895552.576813:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790895552.577252:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790895552.577415:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1790895552.609654:0:14349:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1790895552.610192:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1790895552.610512:0:14406:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1790895552.610592:0:14406:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790895552.612743:0:14406:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790895552.612831:0:14406:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1790895552.612835:0:14406:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1790895552.614945:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790895552.615141:0:14349:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:0.0:1790895552.615355:0:14405:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1790895552.615361:0:14405:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:2.0:1790895552.615711:0:14349:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1790895552.615719:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1790895552.616011:0:14349:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790895552.618233:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1790895552.619680:0:14349:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1790895552.619735:0:14349:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1790895552.621436:0:14349:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1790895552.625748:0:14349:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1790895552.647071:0:14349:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1790895552.647103:0:14349:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9a0b41c6f988 00100000:10000000:1.0:1790895552.647110:0:14349:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1790895552.647908:0:14349:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790895552.647919:0:14349:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790895552.647938:0:14349:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1790895552.647959:0:14349:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1790895553.313049:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895553.563033:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1790895553.688052:0:14364:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1790895553.688060:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf336887800 from 6 10000000:01000000:0.0:1790895553.688078:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1790895553.688119:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895553.688130:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895553.688142:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895553.688172:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758877056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1790895553.688236:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895553.688321:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024c480 going to sleep for 11 seconds 00000100:00100000:3.0:1790895553.688399:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877056 00000100:00100000:3.0:1790895553.688405:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877056 00000100:00100000:3.0:1790895553.688492:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1790895553.688503:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf31813b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14364:x1877889758877056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895553.688516:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895553.688533:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf97b9 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895553.688587:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895553.688598:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895553.688605:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167de00, rc 0) 00000100:00100000:3.0:1790895553.688646:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf31813b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758877056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895553.688653:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790895553.688735:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758877056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895553.688749:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895553.688759:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895553.688806:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758877184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790895553.688833:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895553.688887:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024c480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895553.688990:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877184 00000100:00100000:2.0:1790895553.688995:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877184 00000100:00100000:2.0:1790895553.689023:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1790895553.689099:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758877184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790895553.689110:0:14359:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790895553.689123:0:14359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790895553.689126:0:14359:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1790895553.689206:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758877184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895553.689245:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758877184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1790895553.689276:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1790895553.689281:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895553.689293:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895553.689392:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1790895554.331364:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1790895554.585534:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1790895555.352796:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895556.376853:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895557.401165:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790895557.575055:0:14648:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1790895557.592213:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790895557.592226:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790895557.592229:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790895557.592232:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790895557.592235:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1790895557.592238:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1790895557.592242:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf338c5e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1790895557.592260:0:8:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8cf338c5e000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:3.0:1790895557.592285:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf336e35f80 x1877889758877440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1790895557.592379:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758877440:0@lo:38:kworker.0 00000100:00100000:3.0:1790895557.592445:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895557.592579:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895557.592589:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758877312:0@lo:400:kworker.0 00000100:00100000:2.0:1790895557.592625:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895557.592700:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877312 00000100:00100000:3.0:1790895557.592709:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877312 00000100:00100000:3.0:1790895557.592786:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1790895557.592796:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf31813b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:3310:x1877889758877312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895557.592847:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf31813b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:3310:x1877889758877312:12345-0@lo:400:kworker.0 Request processed in 52us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895557.592854:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1790895557.592975:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877440 00000100:00100000:1.0:1790895557.592980:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877440 00000100:00100000:1.0:1790895557.593002:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895557.593007:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1877889758877440:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1790895557.593029:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:1.0:1790895557.593063:0:14369:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7911a98710cf97c7 00000004:00100000:1.0:1790895557.593077:0:14369:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1790895557.593202:0:14369:0:(import.c:65:import_set_state_nolock()) ffff8cf318f12800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895557.593245:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1877889758877440:12345-0@lo:38:kworker.0 Request processed in 237us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895557.593252:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895557.595793:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758877312:0@lo:400:kworker.0 00010000:00080000:2.0:1790895557.596140:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf336e35f80 x1877889758877440/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790895567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1790895557.596156:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790895557.596165:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1790895557.596171:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790895557.596175:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf338c5e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790895557.596181:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3307:1877889758877440:0@lo:38:kworker.0 00010000:00010000:0.0:1790895558.424119:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895559.449239:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895560.479925:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1790895561.188305:0:14799:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff31cfcba0 20000000:00000080:2.0:1790895561.188322:0:14799:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf3413c1000 uarg=0000000000000000 20000000:01000000:2.0:1790895561.188352:0:14799:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1790895561.188358:0:14799:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1790895561.188362:0:14799:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1790895561.196590:0:14800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1790895561.196736:0:14799:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1790895561.202359:0:14799:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1790895561.202485:0:14799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895561.202506:0:14799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9788 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895561.202513:0:14799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895561.202561:0:14799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf9788 expref: 11 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895561.202576:0:14799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf9788 expref: 11 pid: 14361 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895561.202590:0:14799:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14799:1877889758877568:0@lo:104: 00000100:00100000:3.0:1790895561.202651:0:14799:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895561.202779:0:14799:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33919b900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895561.202809:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877568 00000100:00100000:2.0:1790895561.202816:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877568 00000100:00100000:2.0:1790895561.202914:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895561.202925:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14799:x1877889758877568:12345-0@lo:104: 00010000:00010000:2.0:1790895561.202936:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895561.203019:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790895561.203025:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14799:x1877889758877568:12345-0@lo:104: Request processed in 103us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895561.203028:0:14799:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14799:1877889758877568:0@lo:104: 00000100:00100000:2.0:1790895561.203038:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790895561.203054:0:14799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.203374:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895561.203380:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.203390:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d600 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:1.0:1790895561.203394:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.203402:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1790895561.203420:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895561.203427:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1790895561.203580:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.203588:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1790895561.203621:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.203628:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf33f91d600/0x7911a98710cf9788 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf978f expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.203640:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895561.203642:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895561.203643:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895561.203658:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790895561.203671:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758877696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895561.203703:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895561.203804:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877696 00000100:00100000:1.0:1790895561.203808:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877696 00010000:00010000:1.0:1790895561.203826:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf9788 expref: 12 pid: 14361 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895561.203847:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895561.203852:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:3309:x1877889758877696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895561.203928:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895561.203933:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf9788 expref: 12 pid: 14361 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.203996:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf9788 expref: 12 pid: 14361 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204011:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167c400/0x7911a98710cf978f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf9788 expref: 12 pid: 14361 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204026:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204041:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204055:0:14352:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204113:0:14352:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204118:0:14352:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204123:0:14352:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204126:0:14352:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895561.204128:0:14352:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204133:0:14352:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204143:0:14352:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895561.204150:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895561.204177:0:14799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895561.204184:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:3309:x1877889758877696:12345-0@lo:103:ldlm_bl.0 Request processed in 331us (480us total) trans 0 rc 0/0 00010000:00010000:3.0:1790895561.204193:0:14799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895561.204194:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1790895561.204203:0:14799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167c600/0x7911a98710cf97ce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895561.204529:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758877696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895561.502327:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895562.520109:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790895562.712588:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895562.712601:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790895562.712605:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895562.712608:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1790895562.712740:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790895552/real 1790895552] req@ffff8cf336e34e00 x1877889758874752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895562.712768:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf336e34e00 x1877889758874752/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895562 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895562.712778:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790895552/real 1790895552] req@ffff8cf318e36300 x1877889758874624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895562 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895562.712789:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf318e36300 x1877889758874624/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895562 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790895562.712805:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790895562.712821:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790895562.712825:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758874752:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1790895562.712832:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf3368a1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790895562.712837:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790895562.712840:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758874624:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1790895562.713631:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895562.713650:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758877824:0@lo:400:kworker.0 00000100:00100000:0.0:1790895562.713715:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1790895562.715959:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895562.715968:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790895562.715971:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf3368a1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895562.715979:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1790895562.715985:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790895562.715997:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf3368a1000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895562.716035:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf310110a80 x1877889758878080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790895562.716059:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895562.716062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790895562.716064:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895562.716066:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1790895562.716069:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1790895562.716073:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf340fc7000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895562.716085:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf310113100 x1877889758878208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895562.716110:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1790895562.716125:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758877952:0@lo:400:kworker.0 00000100:00100000:2.0:1790895562.716185:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895562.716241:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758878080:0@lo:8:kworker.0 00000400:00000100:1.0:1790895562.716271:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877889758878080 offset 0 length 520: 4 00000100:00100000:2.0:1790895562.716284:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877952 00000100:00100000:2.0:1790895562.716293:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877952 00000100:00100000:1.0:1790895562.716295:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758878208:0@lo:8:kworker.0 00000400:00000100:1.0:1790895562.716314:0:3307:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877889758878208 offset 0 length 520: 4 00000100:00100000:2.0:1790895562.716370:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895562.716380:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758877952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895562.716443:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758877952:12345-0@lo:400:kworker.0 Request processed in 65us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895562.716450:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1790895562.716485:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf310111f80 x1877889758877952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895562.716499:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758877952:0@lo:400:kworker.0 00000100:00100000:2.0:1790895562.716530:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758877824 00000100:00100000:2.0:1790895562.716535:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758877824 00000100:00100000:0.0:1790895562.717522:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1790895562.717539:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:3308:x1877889758877824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895562.717596:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:3308:x1877889758877824:12345-0@lo:400:kworker.0 Request processed in 64us (3881us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895562.717603:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1790895562.717755:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758877824:0@lo:400:kworker.0 10000000:01000000:1.0:1790895563.160188:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790895563.160196:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf336887800 from 10 10000000:01000000:1.0:1790895563.160202:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790895563.160253:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895563.160281:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895563.160294:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895563.160320:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758878336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790895563.160403:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895563.160472:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3181fa480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895563.160639:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758878336 00000100:00100000:2.0:1790895563.160647:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758878336 00000100:00100000:2.0:1790895563.160706:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1790895563.160716:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+11:14364:x1877889758878336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895563.160730:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895563.160757:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf97d5 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895563.160779:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895563.160790:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895563.160799:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84f400, rc 0) 00000100:00100000:2.0:1790895563.160848:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758878336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895563.160887:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1790895563.161243:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758878336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895563.161258:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895563.161267:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895563.161322:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758878464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895563.161351:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895563.161414:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3181fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895563.161480:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758878464 00000100:00100000:0.0:1790895563.161485:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758878464 00000100:00100000:0.0:1790895563.161526:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1790895563.161543:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758878464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1790895563.162148:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758878464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 613us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895563.162156:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1790895563.162250:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758878464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895563.162284:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758878592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895563.162325:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895563.162360:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3181fa480 going to sleep for 11 seconds 00000100:00100000:0.0:1790895563.162549:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758878592 00000100:00100000:0.0:1790895563.162555:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758878592 00000100:00100000:0.0:1790895563.162589:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1790895563.162596:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758878592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895563.163216:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:14364:x1877889758878592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 619us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895563.163224:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1790895563.163351:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758878592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790895563.166153:0:14878:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790895563.166458:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790895563.166479:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895563.166492:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895563.166504:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895563.544207:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895564.568140:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1790895564.824829:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790895565.592638:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1790895566.078058:0:15048:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1790895566.078062:0:15048:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1790895566.078165:0:15048:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cf3393f8800 00000020:01000004:2.0:1790895566.078181:0:15048:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1790895566.078194:0:15048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1790895566.078209:0:15048:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8cf2030419c0) 00000020:00000080:2.0:1790895566.078227:0:15048:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790895566.094070:0:15048:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790895566.094368:0:15048:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790895566.095454:0:15048:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790895566.095705:0:15048:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790895566.096124:0:15048:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790895566.096529:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 529: rc = 0 00100000:10000000:2.0:1790895566.096614:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 529: rc = 0 00100000:10000000:2.0:1790895566.096707:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 529: rc = 0 00100000:10000000:2.0:1790895566.097270:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 671: rc = 0 00100000:10000000:2.0:1790895566.097604:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 671: rc = 0 00100000:10000000:2.0:1790895566.098029:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 671: rc = 0 00100000:10000000:2.0:1790895566.098294:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 671: rc = 0 00100000:10000000:2.0:1790895566.098639:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 671: rc = 0 00100000:10000000:2.0:1790895566.099017:0:15048:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 671: rc = 0 00000020:00000080:2.0:1790895566.099707:0:15048:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1790895566.099719:0:15048:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790895566.099733:0:15048:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7911a98710cf97ea 00000020:01000004:2.0:1790895566.099742:0:15048:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1790895566.099762:0:15048:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790895566.099765:0:15048:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790895566.099770:0:15048:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1790895566.099774:0:15048:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1790895566.099791:0:15048:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8cf3417d0000) 00000020:00000080:2.0:1790895566.099807:0:15048:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1790895566.101178:0:15048:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790895566.101355:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1790895566.101363:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1790895566.106620:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1790895566.106633:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1790895566.107083:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1790895566.107090:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1790895566.110600:0:15048:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790895566.113508:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1790895566.113523:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1790895566.114361:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1790895566.114371:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1790895566.133116:0:15048:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790895566.133350:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790895566.133357:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1790895566.134651:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790895566.134668:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1790895566.137597:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1790895566.137613:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1790895566.145498:0:15048:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790895566.145715:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1790895566.145722:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1790895566.146670:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1790895566.146680:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1790895566.188666:0:15048:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1790895566.188924:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1790895566.188931:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1790895566.192627:0:15048:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1790895566.192652:0:15048:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1790895566.193517:0:15048:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1790895566.193539:0:15048:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1790895566.193546:0:15048:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1790895566.211215:0:15048:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:0.0:1790895566.211262:0:15048:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.154@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1790895566.211267:0:15048:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1790895566.211269:0:15048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790895566.211270:0:15048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895566.211271:0:15048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895566.211272:0:15048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895566.211273:0:15048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895566.211275:0:15048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895566.211276:0:15048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895566.211278:0:15048:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790895566.211281:0:15048:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1790895566.211284:0:15048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1790895566.211285:0:15048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790895566.211286:0:15048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895566.211287:0:15048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895566.211288:0:15048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895566.211289:0:15048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895566.211290:0:15048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895566.211292:0:15048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895566.211293:0:15048:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1790895566.211342:0:15048:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1790895566.211364:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758878720:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1790895566.211439:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895566.212155:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf307d34c00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895566.214834:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758878720 00000100:00100000:2.0:1790895566.214849:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758878720 00000100:00100000:3.0:1790895566.215027:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1790895566.215039:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:15048:x1877889758878720:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790895566.215080:0:14359:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790895566.215084:0:14359:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1790895566.215088:0:14359:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1790895566.225358:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:15048:x1877889758878720:12345-0@lo:253:mount.lustre.0 Request processed in 10310us (13907us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.225387:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1790895566.225538:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758878720:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790895566.225559:0:15048:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790895566.225562:0:15048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790895566.225564:0:15048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790895566.225565:0:15048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895566.225566:0:15048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895566.225567:0:15048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895566.225569:0:15048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895566.225570:0:15048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895566.225572:0:15048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895566.225574:0:15048:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1790895566.225737:0:15048:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf3393f8800 from lustre-OST0000 10000000:01000000:0.0:1790895566.225765:0:15048:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1790895566.225769:0:15048:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1790895566.225776:0:15048:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf30650b380 local copy 00010000:00010000:0.0:1790895566.225786:0:15048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895566.226153:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758878848:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790895566.226194:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895566.226278:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf307d34c00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895566.226318:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758878848 00000100:00100000:1.0:1790895566.226334:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758878848 00000100:00100000:1.0:1790895566.226410:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1790895566.226418:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:15048:x1877889758878848:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895566.226590:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:15048:x1877889758878848:12345-0@lo:501:mount.lustre.0 Request processed in 172us (395us total) trans 0 rc -2/-2 00000100:00100000:1.0:1790895566.226598:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1790895566.226895:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758878848:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790895566.226911:0:15048:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790895566.227063:0:15048:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790895566.227070:0:15048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.227086:0:15048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895566.227115:0:15048:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf3393f8800 10000000:01000000:2.0:1790895566.227121:0:15048:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790895566.227125:0:15048:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8cf30650b380 10000000:01000000:2.0:1790895566.227128:0:15048:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1790895566.227131:0:15048:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8cf30650b380 from 1 10000000:01000000:2.0:1790895566.227133:0:15048:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1790895566.227164:0:15048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf97f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.227171:0:15048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf97f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.227181:0:15048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf97f8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895566.227195:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758878976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790895566.227226:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895566.228042:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336cc0d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790895566.228120:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758878976 00000100:00100000:0.0:1790895566.228127:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758878976 00000100:00100000:0.0:1790895566.228163:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1790895566.228172:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+12:15048:x1877889758878976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790895566.228184:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895566.228199:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7d400/0x7911a98710cf97ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf97f8 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.228223:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7d400/0x7911a98710cf97ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf97f8 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.228234:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7d400/0x7911a98710cf97ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf97f8 expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.228242:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d400, rc 0) 00000100:00100000:0.0:1790895566.228289:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+13:15048:x1877889758878976:12345-0@lo:101:mount.lustre.0 Request processed in 118us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895566.228296:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1790895566.228380:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758878976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895566.228393:0:15048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf97f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97ff expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.228402:0:15048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf97f8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf97ff expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895566.228432:0:15048:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1790895566.228458:0:15048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf97f8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97ff expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.228465:0:15048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f600/0x7911a98710cf97f8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf97ff expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895566.228471:0:15048:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1790895566.228475:0:15048:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790895566.228482:0:15048:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1790895566.228484:0:15048:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1790895566.228505:0:15048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ea00/0x7911a98710cf9806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.228512:0:15048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ea00/0x7911a98710cf9806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.228520:0:15048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ea00/0x7911a98710cf9806 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895566.228535:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790895566.228564:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895566.228576:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336cc0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1790895566.228771:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758879104 00000100:00100000:1.0:1790895566.228776:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758879104 00000100:00100000:1.0:1790895566.228798:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1790895566.228806:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+13:15048:x1877889758879104:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790895566.228952:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895566.228962:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f91c200/0x7911a98710cf980d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9806 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895566.228979:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f91c200/0x7911a98710cf980d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9806 expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895566.228986:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f91c200/0x7911a98710cf980d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9806 expref: 14 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895566.228992:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c200, rc 0) 00000100:00100000:1.0:1790895566.229020:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879104:12345-0@lo:101:mount.lustre.0 Request processed in 216us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895566.229037:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1790895566.229116:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895566.229126:0:15048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ea00/0x7911a98710cf9806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf980d expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.229342:0:15048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ea00/0x7911a98710cf9806 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf980d expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790895566.230390:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790895566.234016:0:15048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895566.234312:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790895566.234371:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790895566.234408:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790895566.235170:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790895566.235244:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790895566.235276:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790895566.235363:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790895566.235372:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790895566.235540:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895566.235784:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.235967:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803d80 going to sleep for 11 seconds 00000100:00100000:0.0:1790895566.236052:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758879232 00000100:00100000:0.0:1790895566.236067:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758879232 00000100:00100000:0.0:1790895566.236160:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1790895566.236170:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790895566.236851:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879232:12345-0@lo:501:mount.lustre.0 Request processed in 681us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895566.236890:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1790895566.237139:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879232:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895566.237185:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879360:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895566.237230:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.237269:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895566.237339:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758879360 00000100:00100000:2.0:1790895566.237346:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758879360 00000100:00100000:2.0:1790895566.237427:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1790895566.237437:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879360:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790895566.238134:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879360:12345-0@lo:503:mount.lustre.0 Request processed in 698us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895566.238142:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1790895566.238263:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879360:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790895566.239262:0:15048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790895566.239344:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.239396:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.239428:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895566.239552:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758879488 00000100:00100000:2.0:1790895566.239558:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758879488 00000100:00100000:2.0:1790895566.239802:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1790895566.240108:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879488:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790895566.240361:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879488:12345-0@lo:502:mount.lustre.0 Request processed in 549us (964us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895566.240370:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1790895566.240482:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790895566.241003:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1790895566.241059:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1790895566.241094:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1790895566.241167:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1790895566.241206:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1790895566.241241:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1790895566.241292:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1790895566.241341:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1790895566.241377:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1790895566.241429:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1790895566.241489:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1790895566.241538:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1790895566.241578:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.242050:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.242092:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803d80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895566.242207:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758879616 00000100:00100000:2.0:1790895566.242214:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758879616 00000100:00100000:2.0:1790895566.242260:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1790895566.242270:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1790895566.242478:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879616:12345-0@lo:502:mount.lustre.0 Request processed in 208us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895566.242485:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1790895566.242751:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790895566.242925:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:3.0:1790895566.242939:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1790895566.244423:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790895566.244435:0:15062:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1790895566.244505:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.244508:0:15062:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1790895566.244516:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790895566.244531:0:15062:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8cf3031acd40) 00000020:00000080:3.0:1790895566.244553:0:15062:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1790895566.244559:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1790895566.244742:0:15062:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf3393f8800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1790895566.244750:0:15062:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1790895566.244757:0:15062:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7911a98710cf981b 00010000:00010000:3.0:1790895566.253287:0:15062:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1790895566.254436:0:15062:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1790895566.258264:0:15062:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1790895566.260653:0:15062:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1790895566.260786:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895566.260803:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.260805:0:15062:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1790895566.260810:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790895566.260822:0:15062:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:3.0:1790895566.260824:0:15062:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790895566.260826:0:15062:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790895566.260828:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790895566.260831:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.260832:0:15062:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790895566.260835:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895566.260839:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.260840:0:15062:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1790895566.260843:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1790895566.260845:0:15062:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1790895566.260847:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895566.260850:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.260851:0:15062:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1790895566.260853:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895566.260889:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.260891:0:15062:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1790895566.260895:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1790895566.260964:0:15062:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895566.260968:0:15062:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.260969:0:15062:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1790895566.260972:0:15062:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1790895566.268319:0:15048:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1790895566.268380:0:15048:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1790895566.268400:0:15048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ea00/0x7911a98710cf9806 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf980d expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.268413:0:15048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f84ea00/0x7911a98710cf9806 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf980d expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895566.268431:0:15048:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf3393f8800 from 1 10000000:01000000:0.0:1790895566.268434:0:15048:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790895566.268485:0:15048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.268494:0:15048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.268505:0:15048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895566.268531:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790895566.268614:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895566.268678:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31bbcd780 going to sleep for 11 seconds 00000100:00100000:2.0:1790895566.280657:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758879744 00000100:00100000:2.0:1790895566.280688:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758879744 00000100:00100000:2.0:1790895566.280760:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1790895566.280771:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+14:15048:x1877889758879744:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895566.280798:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895566.280830:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9822 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.280882:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9822 expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.280893:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9822 expref: 15 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.280902:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f84fc00, rc 0) 00000100:00100000:2.0:1790895566.280986:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758879744:12345-0@lo:101:mount.lustre.0 Request processed in 217us (12372us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895566.280993:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1790895566.284080:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1790895566.284110:0:15048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895566.284122:0:15048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790895566.284895:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1790895566.285380:0:15048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790895566.286188:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1790895566.286244:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1790895566.286316:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1790895566.286338:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1790895566.286437:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895566.287082:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895566.287127:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895566.287209:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758879872 00000100:00100000:2.0:1790895566.287217:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758879872 00000100:00100000:2.0:1790895566.287273:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1790895566.287284:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758879872:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790895566.287765:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758879872:12345-0@lo:501:mount.lustre.0 Request processed in 481us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895566.287774:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1790895566.288094:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758879872:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895566.288144:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880000:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790895566.288191:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895566.288219:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895566.288273:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880000 00000100:00100000:2.0:1790895566.288279:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880000 00000100:00100000:2.0:1790895566.288354:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1790895566.288363:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758880000:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1790895566.288531:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758880000:12345-0@lo:503:mount.lustre.0 Request processed in 169us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895566.288546:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1790895566.288626:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880000:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790895566.289170:0:15048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790895566.289243:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880128:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895566.289284:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895566.293093:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.293193:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880128 00000100:00100000:3.0:1790895566.293204:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880128 00000100:00100000:3.0:1790895566.293253:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1790895566.293263:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758880128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.293573:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758880128:12345-0@lo:502:mount.lustre.0 Request processed in 311us (4287us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.293581:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1790895566.293807:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880128:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790895566.294133:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790895566.294188:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790895566.294238:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790895566.294276:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790895566.294311:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790895566.294372:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790895566.294407:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790895566.294438:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790895566.294492:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895566.294545:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895566.294571:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.294992:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880256 00000100:00100000:3.0:1790895566.295006:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880256 00000100:00100000:3.0:1790895566.295034:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1790895566.295041:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758880256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.295223:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758880256:12345-0@lo:502:mount.lustre.0 Request processed in 182us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.295230:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1790895566.295344:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880256:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790895566.295516:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790895566.295528:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1790895566.297319:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895566.297343:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.297346:0:15066:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1790895566.297354:0:15066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf3393f8800 00000020:00000080:3.0:1790895566.297357:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790895566.297363:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895566.297366:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.297368:0:15066:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1790895566.297370:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895566.297373:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.297374:0:15066:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1790895566.297377:0:15066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf3393f8800 00000020:00000080:3.0:1790895566.297379:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790895566.297457:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895566.297461:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.297462:0:15066:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1790895566.297464:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790895566.297467:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.297468:0:15066:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1790895566.297472:0:15066:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf3393f8800 00000020:00000080:3.0:1790895566.297474:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1790895566.297508:0:15066:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790895566.297511:0:15066:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790895566.297513:0:15066:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1790895566.297516:0:15066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1790895566.297679:0:15048:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1790895566.297706:0:15048:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895566.297728:0:15048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.297739:0:15048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895566.297782:0:15048:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1790895566.297785:0:15048:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf3393f8800 10000000:01000000:2.0:1790895566.297788:0:15048:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf3393f8800 10000000:01000000:2.0:1790895566.297792:0:15048:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790895566.297797:0:15048:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf3393f8800 from 1 10000000:01000000:2.0:1790895566.297800:0:15048:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1790895566.297849:0:15048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f000/0x7911a98710cf9830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.297891:0:15048:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f000/0x7911a98710cf9830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.297904:0:15048:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f000/0x7911a98710cf9830 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895566.297930:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790895566.297996:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895566.298039:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336cc0900 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.298399:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880384 00000100:00100000:3.0:1790895566.298420:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880384 00000100:00100000:3.0:1790895566.298468:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1790895566.298477:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758880384:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895566.298490:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895566.298502:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167c800/0x7911a98710cf9837 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9830 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895566.298525:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c800/0x7911a98710cf9837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9830 expref: 16 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895566.298536:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167c800/0x7911a98710cf9837 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9830 expref: 16 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895566.298544:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c800, rc 0) 00000100:00100000:3.0:1790895566.298587:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880384:12345-0@lo:101:mount.lustre.0 Request processed in 112us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.298734:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1790895566.298946:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895566.298961:0:15048:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f000/0x7911a98710cf9830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9837 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895566.298979:0:15048:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f000/0x7911a98710cf9830 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9837 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790895566.301285:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1790895566.306270:0:15048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790895566.307104:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1790895566.307151:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1790895566.307184:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1790895566.307230:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1790895566.307267:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1790895566.307311:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1790895566.307359:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1790895566.307390:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1790895566.307429:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790895566.319922:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790895566.320017:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790895566.320100:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790895566.320140:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790895566.320173:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790895566.320222:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790895566.320259:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790895566.320293:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790895566.320356:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790895566.320411:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790895566.330933:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790895566.331059:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790895566.331091:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790895566.331129:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790895566.331166:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790895566.331193:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790895566.331222:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790895566.331268:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790895566.331305:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790895566.334621:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790895566.334644:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1790895566.335546:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895566.335617:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.335734:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880512 00000100:00100000:3.0:1790895566.335742:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880512 00000100:00100000:3.0:1790895566.335790:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790895566.335799:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895566.337352:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880512:12345-0@lo:501:mount.lustre.0 Request processed in 1547us (1728us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.337362:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1790895566.338836:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.338887:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895566.338941:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895566.338998:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.339029:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880640 00000100:00100000:3.0:1790895566.339035:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880640 00000100:00100000:3.0:1790895566.339079:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790895566.339087:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895566.339247:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880640:12345-0@lo:503:mount.lustre.0 Request processed in 159us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.339263:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1790895566.339376:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.339390:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1790895566.339980:0:15048:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790895566.340052:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.340095:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.340129:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880768 00000100:00100000:3.0:1790895566.340134:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880768 00000100:00100000:3.0:1790895566.340163:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790895566.340171:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.346731:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880768:12345-0@lo:502:mount.lustre.0 Request processed in 6550us (6626us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.346746:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1790895566.346848:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.347071:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790895566.347376:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1790895566.347439:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1790895566.347471:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1790895566.347515:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1790895566.347550:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1790895566.347600:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1790895566.347634:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1790895566.347677:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1790895566.347725:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1790895566.347763:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1790895566.347796:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1790895566.348032:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1790895566.348082:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1790895566.348114:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1790895566.348164:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1790895566.348202:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1790895566.348254:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1790895566.348303:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1790895566.348348:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1790895566.348381:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1790895566.348429:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1790895566.348466:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1790895566.348500:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1790895566.348549:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1790895566.348584:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1790895566.348617:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1790895566.348733:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1790895566.348773:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1790895566.348802:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1790895566.361035:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1790895566.361099:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1790895566.361131:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1790895566.361177:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1790895566.361240:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1790895566.361281:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1790895566.361344:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1790895566.361382:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1790895566.361417:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1790895566.361466:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1790895566.361501:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1790895566.361555:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.361639:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.361834:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758880896 00000100:00100000:3.0:1790895566.361843:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758880896 00000100:00100000:3.0:1790895566.361919:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790895566.361928:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895566.362138:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758880896:12345-0@lo:502:mount.lustre.0 Request processed in 210us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.362146:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1790895566.362206:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.362233:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758880896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1790895566.362310:0:15048:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1790895566.362320:0:15048:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1790895566.376504:0:15071:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1790895566.376522:0:15071:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8cf3031a8000) 00000020:00000080:3.0:1790895566.376543:0:15071:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1790895566.376634:0:15071:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf3393f8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790895566.376639:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf3393f8800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1790895566.376641:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf3393f8800 3 00010000:00080000:3.0:1790895566.376673:0:15071:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf310c5c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.154@tcp at head 00010000:00010000:3.0:1790895566.378212:0:15071:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1790895566.383280:0:15071:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1790895566.383332:0:15071:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1790895566.383346:0:15071:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7911a98710cf9845 00000100:00080000:1.0:1790895566.383357:0:15071:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790895566.383370:0:15071:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8cf310c5c000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:1.0:1790895566.383408:0:15071:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf3397f2300 x1877889758881024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895566.383477:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758881024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790895566.383551:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1790895566.383622:0:15071:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1790895566.384077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790895566.384083:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1790895566.384085:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1790895566.384088:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790895566.384228:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758881152:0@lo:400:kworker.0 00000100:00100000:3.0:1790895566.384268:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.384316:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881024 00000100:00100000:3.0:1790895566.384334:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881024 00000100:00100000:3.0:1790895566.384362:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881152 00000100:00100000:3.0:1790895566.384376:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881152 00000100:00100000:3.0:1790895566.384406:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790895566.384415:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758881152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895566.384472:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758881152:12345-0@lo:400:kworker.0 Request processed in 57us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.384480:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790895566.384496:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790895566.384501:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3307:x1877889758881024:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1790895566.384524:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 439 last 0 00000020:00000080:3.0:1790895566.384566:0:14369:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7911a98710cf984c 00000004:00100000:3.0:1790895566.384589:0:14369:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1790895566.384631:0:14369:0:(import.c:65:import_set_state_nolock()) ffff8cf310c59800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790895566.386608:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1877889758881024:12345-0@lo:38:llog_process_th.0 Request processed in 2095us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895566.386623:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790895566.386754:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf336e35180 x1877889758881152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895566.386769:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758881152:0@lo:400:kworker.0 00010000:00080000:2.0:1790895566.391948:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8cf3397f2300 x1877889758881024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790895576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895566.391966:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790895566.391979:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1790895566.391989:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790895566.391994:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790895566.391998:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf310c5c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790895566.392006:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3307:1877889758881024:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1790895566.393003:0:15071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1790895566.393539:0:15048:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1790895566.393566:0:15048:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790895566.393582:0:15048:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f000/0x7911a98710cf9830 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9837 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895566.393592:0:15048:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f84f000/0x7911a98710cf9830 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9837 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790895566.393646:0:15048:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790895566.393649:0:15048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790895566.393650:0:15048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790895566.393651:0:15048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790895566.393653:0:15048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790895566.393654:0:15048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790895566.393655:0:15048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790895566.394761:0:15048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790895566.394765:0:15048:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790895566.394770:0:15048:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1790895566.394774:0:15048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790895566.394776:0:15048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1790895566.394777:0:15048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790895566.394778:0:15048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790895566.394779:0:15048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790895566.394781:0:15048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790895566.394782:0:15048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1790895566.394783:0:15048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790895566.394784:0:15048:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790895566.395123:0:15048:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1790895566.395150:0:15048:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758881280:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1790895566.395760:0:15048:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895566.395805:0:15048:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305803f00 going to sleep for 11 seconds 00000100:00100000:3.0:1790895566.396331:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881280 00000100:00100000:3.0:1790895566.396340:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881280 00000100:00100000:3.0:1790895566.396389:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1790895566.396398:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15048:x1877889758881280:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1790895566.396428:0:14362:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1790895566.396444:0:14362:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1790895566.428411:0:14362:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1790895566.428463:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1790895566.428509:0:14383:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1790895566.428530:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1790895566.428554:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.428573:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.428582:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.428625:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.428640:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 16 pid: 14361 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895566.428654:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1877889758881408:0@lo:104: 00000100:00100000:0.0:1790895566.428808:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895566.428952:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf302b8c900 going to sleep for 11 seconds 00000100:00100000:0.0:1790895566.428987:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881408 00000100:00100000:0.0:1790895566.428998:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881408 00000100:00100000:0.0:1790895566.429158:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895566.429170:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14383:x1877889758881408:12345-0@lo:104: 00010000:00010000:0.0:1790895566.429184:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.429313:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790895566.429329:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14383:x1877889758881408:12345-0@lo:104: Request processed in 153us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895566.429337:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790895566.429413:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1877889758881408:0@lo:104: 00010000:00010000:2.0:1790895566.429435:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.429631:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895566.429638:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.429645:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c200 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895566.429649:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.429722:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895566.429732:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895566.429738:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790895566.429775:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.429781:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1790895566.429845:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758881536:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1790895566.429896:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895566.430068:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430076:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7c200/0x7911a98710cf97b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf97c0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430094:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895566.430096:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895566.430098:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895566.430112:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881536 00000100:00100000:0.0:1790895566.430118:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881536 00010000:00010000:0.0:1790895566.430138:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 17 pid: 14361 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895566.430171:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895566.430178:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:3308:x1877889758881536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895566.430190:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895566.430196:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 17 pid: 14361 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430283:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 17 pid: 14361 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430297:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167de00/0x7911a98710cf97c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf97b9 expref: 17 pid: 14361 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430311:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430330:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790895566.430345:0:14354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001816094s 00010000:00010000:0.0:1790895566.430349:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430356:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430363:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430369:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430381:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895566.430385:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430392:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430405:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895566.430415:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895566.430825:0:14383:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895566.430846:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895566.430852:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7ca00/0x7911a98710cf9853 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895566.435482:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:3308:x1877889758881536:12345-0@lo:103:ldlm_bl.0 Request processed in 5296us (5577us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895566.435498:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790895566.436359:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:15048:x1877889758881280:12345-0@lo:253:mount.lustre.0 Request processed in 39960us (40598us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895566.436370:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1790895566.436475:0:15048:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15048:1877889758881280:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1790895566.436492:0:15048:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1790895566.436495:0:15048:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1790895566.436497:0:15048:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1790895566.436498:0:15048:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1790895566.436499:0:15048:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1790895566.436501:0:15048:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1790895566.436502:0:15048:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1790895566.436504:0:15048:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1790895566.436505:0:15048:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1790895566.436507:0:15048:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1790895566.436521:0:15048:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1790895566.438799:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758881536:0@lo:103:ldlm_bl.0 00080000:10000000:2.0:1790895566.444171:0:15048:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895566.444513:0:15048:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790895566.445342:0:15048:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1790895566.445526:0:15048:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790895566.446136:0:15048:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1790895566.446432:0:15048:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1790895566.447776:0:15048:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1790895566.494113:0:15048:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1790895566.494190:0:15048:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1790895566.494293:0:15048:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1790895566.494368:0:15048:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1790895566.494384:0:15048:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1790895566.494417:0:15048:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1790895566.617996:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895567.641159:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1790895567.896197:0:14364:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1790895567.896207:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf336887800 from 7 10000000:01000000:3.0:1790895567.896211:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790895567.896262:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895567.896274:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895567.896285:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895567.896320:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758881664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790895567.896490:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895567.896544:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1790895567.896655:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881664 00000100:00100000:0.0:1790895567.896663:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881664 00000100:00100000:0.0:1790895567.896712:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1790895567.896735:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+15:14364:x1877889758881664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895567.896748:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895567.896760:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf985a expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895567.896797:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf985a expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895567.896808:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf985a expref: 16 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895567.896816:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7ce00, rc 0) 00000100:00100000:0.0:1790895567.896891:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:14364:x1877889758881664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895567.896898:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1790895567.896974:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758881664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895567.896987:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895567.897011:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895567.897058:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758881792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1790895567.897085:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895567.897106:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8ae600 going to sleep for 11 seconds 00000100:00100000:0.0:1790895567.897182:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881792 00000100:00100000:0.0:1790895567.897187:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881792 00000100:00100000:0.0:1790895567.897212:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1790895567.897218:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:14364:x1877889758881792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1790895567.897230:0:14362:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1790895567.897244:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1790895567.897247:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1790895567.897325:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:14364:x1877889758881792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895567.897332:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1790895567.897481:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758881792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790895567.897532:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790895567.897539:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895567.897547:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895568.663992:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895569.689461:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895570.712018:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1790895571.417964:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895571.417971:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1790895571.417974:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895571.417977:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1790895571.418065:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1790895571.418086:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758881920:0@lo:400:kworker.0 00000100:00100000:3.0:1790895571.418160:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895571.418230:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758882048:0@lo:400:kworker.0 00000100:00100000:3.0:1790895571.418270:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895571.418306:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895571.418312:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758882176:0@lo:400:kworker.0 00000100:00100000:3.0:1790895571.418339:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895571.418374:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882048 00000100:00100000:3.0:1790895571.418382:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882048 00000100:00100000:3.0:1790895571.418433:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882176 00000100:00100000:3.0:1790895571.418437:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882176 00000100:00100000:3.0:1790895571.418463:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790895571.418471:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758882048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895571.418521:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758882048:12345-0@lo:400:kworker.0 Request processed in 51us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895571.418528:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790895571.418544:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790895571.418550:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758882176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895571.418596:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758882176:12345-0@lo:400:kworker.0 Request processed in 46us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895571.418603:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1790895571.418642:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310110700 x1877889758882176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895571.418655:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758882176:0@lo:400:kworker.0 00010000:00080000:3.0:1790895571.418666:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310111c00 x1877889758882048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895571.418674:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758882048:0@lo:400:kworker.0 00000100:00100000:2.0:1790895571.418890:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758881920 00000100:00100000:2.0:1790895571.418895:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758881920 00000100:00100000:2.0:1790895571.418932:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1790895571.418939:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:3308:x1877889758881920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895571.418974:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:3308:x1877889758881920:12345-0@lo:400:kworker.0 Request processed in 36us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895571.418980:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1790895571.419063:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758881920:0@lo:400:kworker.0 00000100:00080000:1.0:1790895571.419152:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1790895571.736447:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1790895572.446239:0:15414:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1790895572.761634:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895573.786828:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790895574.041493:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1790895574.815091:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895575.838182:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1790895576.545200:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790895576.545219:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1790895576.545222:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1790895576.545225:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1790895576.545274:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758882432:0@lo:400:kworker.0 00000100:00100000:0.0:1790895576.545340:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895576.545378:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882432 00000100:00100000:2.0:1790895576.545385:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882432 00000100:00100000:0.0:1790895576.545400:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1790895576.545407:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758882304:0@lo:400:kworker.0 00000100:00100000:0.0:1790895576.545435:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895576.545471:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758882560:0@lo:400:kworker.0 00000100:00100000:2.0:1790895576.545494:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790895576.545500:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895576.545506:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758882432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895576.545539:0:14368:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1790895576.545547:0:14368:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1790895576.545569:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758882432:12345-0@lo:400:kworker.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895576.545578:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790895576.545595:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882560 00000100:00100000:2.0:1790895576.545598:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882560 00000100:00100000:2.0:1790895576.545619:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790895576.545623:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758882560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895576.545648:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758882560:12345-0@lo:400:kworker.0 Request processed in 25us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895576.545653:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790895576.545669:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882304 00000100:00100000:2.0:1790895576.545671:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882304 00000100:00100000:2.0:1790895576.545688:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1790895576.545693:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:3309:x1877889758882304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895576.545712:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:3309:x1877889758882304:12345-0@lo:400:kworker.0 Request processed in 19us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895576.545716:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1790895576.545747:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790895576.545770:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf318e35880 x1877889758882560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895576.545781:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758882560:0@lo:400:kworker.0 00000100:00100000:2.0:1790895576.545807:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758882304:0@lo:400:kworker.0 00010000:00080000:2.0:1790895576.545827:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf318e35500 x1877889758882432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895576.545836:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758882432:0@lo:400:kworker.0 00010000:00010000:0.0:1790895576.856487:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895577.689616:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790895562/real 1790895562] req@ffff8cf310110a80 x1877889758878080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895577.689649:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf310110a80 x1877889758878080/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895577.689660:0:3307:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790895562/real 1790895562] req@ffff8cf310113100 x1877889758878208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895577 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895577.689672:0:3307:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8cf310113100 x1877889758878208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790895577 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1790895577.689692:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf3368a1000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790895577.689718:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790895577.689723:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758878080:0@lo:8:kworker.0 00000100:00080000:1.0:1790895577.689745:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1790895577.689751:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1790895577.689754:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758878208:0@lo:8:kworker.0 00000100:00080000:2.0:1790895577.689963:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895577.689968:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1790895577.689972:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cf3368a1000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895577.689977:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1790895577.689982:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790895577.689993:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8cf3368a1000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895577.690016:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf310112680 x1877889758882816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790895577.690032:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895577.690035:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790895577.690037:0:36:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895577.690039:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 435 00000100:00080000:2.0:1790895577.690042:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1790895577.690046:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf340fc7000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895577.690056:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf310113480 x1877889758882944/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895577.690105:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758883072:0@lo:400:kworker.0 00000100:00100000:2.0:1790895577.690186:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895577.690241:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895577.690248:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758883200:0@lo:400:kworker.0 00000100:00100000:2.0:1790895577.690270:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895577.690321:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883072 00000100:00100000:2.0:1790895577.690330:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883072 00000100:00100000:2.0:1790895577.690372:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883200 00000100:00100000:2.0:1790895577.690375:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883200 00000100:00100000:2.0:1790895577.690398:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790895577.690407:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758883072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895577.690455:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758883072:12345-0@lo:400:kworker.0 Request processed in 48us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895577.690462:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790895577.690477:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895577.690483:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758883200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895577.690508:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758883200:12345-0@lo:400:kworker.0 Request processed in 25us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895577.690514:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895577.690539:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758882816:0@lo:8:kworker.0 00000100:00100000:2.0:1790895577.690568:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895577.690590:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758882944:0@lo:8:kworker.0 00000100:00100000:2.0:1790895577.690611:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895577.690657:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882816 00000100:00100000:2.0:1790895577.690661:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882816 00000100:00100000:2.0:1790895577.690676:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882944 00000100:00100000:2.0:1790895577.690678:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882944 00000100:00100000:2.0:1790895577.690687:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895577.690692:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1877889758882816:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790895577.690714:0:15049:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1790895577.690739:0:15049:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf9868 00002000:00100000:2.0:1790895577.690752:0:15049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8cf303044000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1790895577.690761:0:15049:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1790895577.690763:0:15049:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790895577.691080:0:15049:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790895577.691100:0:15049:0:(import.c:65:import_set_state_nolock()) ffff8cf303040800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895577.691148:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1877889758882816:12345-0@lo:8:kworker.0 Request processed in 455us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895577.691155:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1790895577.691167:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895577.691171:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1877889758882944:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1790895577.691180:0:15049:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1790895577.691204:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1877889758882944:12345-0@lo:8:kworker.0 Request processed in 31us (591us total) trans 0 rc -19/-19 00000100:00100000:2.0:1790895577.691209:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1790895577.691244:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310112680 x1877889758882816/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790895597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895577.691254:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790895577.691260:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1790895577.691266:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1790895577.691271:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1790895577.691272:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf3368a1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1790895577.691294:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1790895577.691299:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758882816:0@lo:8:kworker.0 00000100:00080000:2.0:1790895577.691311:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790895577.691315:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1790895577.691317:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758882944:0@lo:8:kworker.0 00000004:00080000:1.0:1790895577.691341:0:14389:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1790895577.691366:0:14390:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1790895577.691381:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1877889758883456:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790895577.691404:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895577.691419:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932480 going to sleep for 11 seconds 00010000:00080000:2.0:1790895577.691438:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310112d80 x1877889758883200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895577.691447:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758883200:0@lo:400:kworker.0 00010000:00080000:2.0:1790895577.691456:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310110e00 x1877889758883072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895593 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895577.691463:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758883072:0@lo:400:kworker.0 00000100:00100000:2.0:1790895577.691481:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883456 00000100:00100000:2.0:1790895577.691485:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883456 00000100:00100000:2.0:1790895577.691512:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790895577.691519:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1877889758883456:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1790895577.691769:0:14389:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 450658910192ns, next at 0ns, rc = 0 00000100:00100000:3.0:1790895577.693094:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758883328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1790895577.693166:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895577.693203:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1790895577.693211:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758882688:0@lo:400:kworker.0 00000100:00100000:3.0:1790895577.693239:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895577.693333:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758882688 00000100:00100000:3.0:1790895577.693340:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758882688 00000100:00100000:3.0:1790895577.693381:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790895577.693390:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:3310:x1877889758882688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895577.693440:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:3310:x1877889758882688:12345-0@lo:400:kworker.0 Request processed in 51us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895577.693446:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1790895577.693486:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758882688:0@lo:400:kworker.0 00000100:00100000:1.0:1790895577.693696:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883328 00000100:00100000:1.0:1790895577.693701:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883328 00000100:00100000:1.0:1790895577.693741:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895577.693748:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758883328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1790895577.693774:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1790895577.693819:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758883328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895577.693825:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1790895577.695723:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310113480 x1877889758883328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895593 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790895577.695760:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310113480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758883328:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1790895577.699902:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1790895577.700221:0:15049:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1790895577.700231:0:15049:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1790895577.700236:0:15049:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:2.0:1790895577.712083:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.712097:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712116:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.712120:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.712139:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712169:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712182:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712189:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712216:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.712233:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.712239:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712247:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.712252:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712261:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712280:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712288:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000265bf2eb/0x7911a98710cf986f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712314:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.712316:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.712318:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.712843:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.712851:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712887:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.712890:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.712895:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712905:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712912:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712919:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712935:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.712945:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.712949:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712967:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.712970:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712978:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712991:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.712998:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecf3061a/0x7911a98710cf9876 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713011:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.713013:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.713015:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.713449:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.713457:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713466:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.713469:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.713474:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713484:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713499:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713506:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713521:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.713530:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.713535:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713542:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.713545:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713552:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713564:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713571:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000036673718/0x7911a98710cf987d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.713583:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.713591:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.713593:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.714057:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.714064:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714073:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.714077:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.714081:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714091:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714101:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714109:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714124:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.714146:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.714150:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714157:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.714160:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714179:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714190:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714197:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f812a52/0x7911a98710cf9884 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714210:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.714211:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.714212:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.714642:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.714649:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714658:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.714661:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.714664:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714673:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714681:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714694:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714709:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.714719:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.714722:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714730:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84fa00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.714733:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714741:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714752:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714760:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005042d82/0x7911a98710cf988b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.714774:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.714776:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.714777:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.716082:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.716103:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716119:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.716124:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.716139:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716155:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716166:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716173:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716192:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.716208:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.716213:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716220:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84f200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.716223:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716231:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716255:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716262:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bfbd013/0x7911a98710cf9892 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716276:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.716278:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.716280:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.716734:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.716741:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716749:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.716752:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.716756:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716767:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716776:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716783:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716811:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.716820:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.716824:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716831:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84e400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.716835:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716843:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716853:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716884:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004d15d3f7/0x7911a98710cf9899 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.716898:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.716900:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.716902:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.717307:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.717314:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717323:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.717331:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.717336:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717344:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717353:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717359:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717373:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.717381:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.717385:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717392:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f84ee00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.717396:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717404:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717414:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717431:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008575fd84/0x7911a98710cf98a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717443:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.717444:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.717446:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.717842:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.717848:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717896:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.717900:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.717905:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717914:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717922:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717928:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717940:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1790895577.717949:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895577.717957:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717964:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895577.717968:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717975:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717985:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.717992:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf98a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718004:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.718005:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.718007:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.718431:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.718437:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718446:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.718448:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.718452:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718472:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718481:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718488:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718511:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895577.718595:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895577.718601:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.718609:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54c00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895577.718612:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.718686:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.718707:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.718714:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c24bfcff/0x7911a98710cf98ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.718729:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895577.718731:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895577.718732:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.718925:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.718931:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718941:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.718944:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.718948:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718956:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718964:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.718982:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.719004:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895577.719038:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895577.719042:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.719050:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55a00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895577.719054:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.719062:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.719073:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.719080:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071a623aa/0x7911a98710cf98b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.719104:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895577.719106:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895577.719108:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.719935:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.719944:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.719956:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.719959:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.719963:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.719974:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.719981:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.719988:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.720207:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790895577.720617:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.720624:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.720638:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.720641:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.720646:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.720656:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.720664:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.720671:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.720686:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790895577.721181:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.721187:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721196:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.721199:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.721207:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721218:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721237:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721244:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721252:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790895577.721643:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.721649:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721657:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.721660:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.721664:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721674:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721682:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721689:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.721709:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1790895577.722626:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.722635:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.722646:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.722649:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.722653:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.722662:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.722671:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.722679:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.722688:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1790895577.723181:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.723187:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723195:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.723204:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.723208:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723218:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723226:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723233:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723241:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1790895577.723370:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1790895577.723380:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723388:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55c00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.723393:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723402:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723425:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723442:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000318667e4/0x7911a98710cf98bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723462:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790895577.723466:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723472:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.723476:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723483:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723495:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723501:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf98c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723514:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790895577.723518:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723523:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.723532:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723540:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723566:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.723573:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7e505a/0x7911a98710cf98ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895577.723941:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.723948:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723958:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.723961:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.723966:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723976:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723985:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.723998:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.724006:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1790895577.724413:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.724421:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.724429:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.724433:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.724437:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.724447:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.724455:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.724462:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.724472:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1790895577.724938:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.724945:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725151:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1790895577.725163:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725174:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54e00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.725178:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725190:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725214:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725228:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbf8a08a/0x7911a98710cf98d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725251:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790895577.725259:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725271:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.725275:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725283:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725302:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725309:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b8baa030/0x7911a98710cf98d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725320:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790895577.725326:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725336:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.725342:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725366:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725379:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725387:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efcde858/0x7911a98710cf98df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725407:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790895577.725411:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725418:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54a00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.725424:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725435:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725447:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725454:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf98e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725488:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895577.725491:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725500:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.725504:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725511:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725522:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725528:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d260e2b/0x7911a98710cf98ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725541:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.725542:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.725544:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895577.725761:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.725768:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.725773:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.725787:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.725797:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.725808:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.725835:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790895577.725892:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895577.725900:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725907:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.725927:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725935:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725950:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725962:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7d3fed4/0x7911a98710cf98f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.725980:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.725982:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.725986:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.727288:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.727302:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.727320:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.727325:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.727330:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.727343:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.727369:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.727376:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.731194:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790895577.732462:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895577.732474:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.732490:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55e00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.732495:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.732507:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.732531:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.732550:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000407e169b/0x7911a98710cf98fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.732584:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.732586:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.732588:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.733064:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.733073:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733087:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.733092:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.733100:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733113:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733123:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733143:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733176:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790895577.733631:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.733638:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733647:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.733650:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.733654:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733663:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733671:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733678:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.733686:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1790895577.734094:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.734101:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734110:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.734119:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.734124:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734148:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734157:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734163:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734171:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1790895577.734598:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.734605:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734615:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.734618:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.734622:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734633:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734641:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734655:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.734664:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1790895577.734723:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1790895577.734734:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734744:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895577.734750:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734762:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734782:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734791:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe8116e/0x7911a98710cf9902 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734814:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1790895577.734818:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734825:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895577.734835:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734844:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734855:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734879:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f52f4c4/0x7911a98710cf9909 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734893:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790895577.734897:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734903:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895577.734906:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734913:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734921:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734928:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da8d4dee/0x7911a98710cf9910 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734946:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895577.734949:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734955:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895577.734958:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734964:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734975:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734983:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9917 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895577.734994:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895577.734995:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895577.734997:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1790895577.735088:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.735095:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735104:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.735107:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.735111:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735120:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735138:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735145:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735166:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1790895577.735573:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1790895577.735579:0:15049:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735592:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=450s v=(0 0) 00010000:00010000:2.0:1790895577.735595:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895577.735599:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735608:0:15049:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735616:0:15049:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735624:0:15049:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895577.735633:0:15049:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1790895577.735816:0:15049:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1790895577.735995:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14390:x1877889758883456:12345-0@lo:5:osp-pre-0-0.0 Request processed in 44471us (44585us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895577.736006:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790895577.736073:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1877889758883456:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1790895577.736092:0:14390:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00010000:00010000:0.0:1790895577.736843:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790895577.736853:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736881:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337684c00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.736886:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736896:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736915:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736923:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a43b5e83/0x7911a98710cf991e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736943:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895577.736947:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736962:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685a00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895577.736966:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736973:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736984:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.736992:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000160ce1e7/0x7911a98710cf9925 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895577.737018:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.737020:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895577.737021:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895577.737345:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895577.744720:0:14390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1877889758883584:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1790895577.744813:0:14390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895577.744877:0:14390:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da900 going to sleep for 11 seconds 00000100:00100000:2.0:1790895577.744912:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883584 00000100:00100000:2.0:1790895577.744921:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883584 00000100:00100000:2.0:1790895577.744968:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790895577.744977:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14390:x1877889758883584:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1790895577.745023:0:15052:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1790895577.754546:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14390:x1877889758883584:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9559us (9723us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1790895577.754560:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790895577.754783:0:14390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14390:1877889758883584:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1790895577.754800:0:14390:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:0.0:1790895577.777204:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1790895577.884605:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895578.904427:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1790895579.125367:0:15765:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1790895579.125371:0:15765:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1790895579.125489:0:15765:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8cf310c5e800 00000020:01000004:3.0:1790895579.125506:0:15765:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1790895579.125519:0:15765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1790895579.125546:0:15765:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8cf20363b380) 00000020:00000080:3.0:1790895579.125563:0:15765:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1790895579.155600:0:15765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1790895579.156157:0:15765:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1790895579.157154:0:15765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1790895579.157544:0:15765:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1790895579.157836:0:15765:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790895579.158342:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 519: rc = 0 00100000:10000000:2.0:1790895579.158543:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 519: rc = 0 00100000:10000000:2.0:1790895579.158633:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 519: rc = 0 00100000:10000000:2.0:1790895579.159545:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1790895579.164288:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 768: rc = 0 00100000:10000000:2.0:1790895579.164597:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 768: rc = 0 00100000:10000000:2.0:1790895579.167248:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 768: rc = 0 00100000:10000000:2.0:1790895579.167540:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 768: rc = 0 00100000:10000000:2.0:1790895579.171527:0:15765:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 768: rc = 0 00000020:00000080:2.0:1790895579.172333:0:15765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1790895579.172485:0:15765:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1790895579.172497:0:15765:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7911a98710cf9933 00000020:01000004:2.0:1790895579.172506:0:15765:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1790895579.172536:0:15765:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.154@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1790895579.172539:0:15765:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.154@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1790895579.172546:0:15765:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1790895579.172660:0:15765:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1790895579.172666:0:15765:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.154@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1790895579.185002:0:15765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.154@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790895579.185048:0:15765:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.154@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1790895579.185053:0:15765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790895579.185055:0:15765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790895579.185056:0:15765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790895579.185058:0:15765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790895579.185059:0:15765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790895579.185060:0:15765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790895579.185062:0:15765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790895579.185063:0:15765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790895579.185064:0:15765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790895579.185069:0:15765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1790895579.185071:0:15765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790895579.185072:0:15765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790895579.185073:0:15765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790895579.185074:0:15765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790895579.185075:0:15765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790895579.185076:0:15765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790895579.185077:0:15765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790895579.185078:0:15765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790895579.185080:0:15765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790895579.185701:0:15765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1790895579.185727:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758883712:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1790895579.185799:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895579.186052:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180da9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895579.186093:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883712 00000100:00100000:0.0:1790895579.186101:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883712 00000100:00100000:0.0:1790895579.186209:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1790895579.186221:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15765:x1877889758883712:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1790895579.186264:0:14362:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1790895579.186273:0:14362:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1790895579.186278:0:14362:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1790895579.200464:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15765:x1877889758883712:12345-0@lo:253:mount.lustre.0 Request processed in 14235us (14655us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895579.200482:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1790895579.200572:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758883712:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1790895579.200587:0:15765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1790895579.200590:0:15765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790895579.200592:0:15765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1790895579.200607:0:15765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790895579.200608:0:15765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790895579.200609:0:15765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790895579.200610:0:15765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790895579.200612:0:15765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1790895579.200614:0:15765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790895579.200615:0:15765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790895579.200634:0:15765:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8cf310c5e800 from lustre-OST0001 10000000:01000000:2.0:1790895579.200673:0:15765:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1790895579.200677:0:15765:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790895579.200685:0:15765:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8cf30650b380 local copy 00010000:00010000:2.0:1790895579.200696:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895579.201007:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758883840:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790895579.201043:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895579.201137:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895579.201172:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883840 00000100:00100000:0.0:1790895579.201177:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883840 00000100:00100000:0.0:1790895579.201240:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1790895579.201246:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15765:x1877889758883840:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790895579.201405:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15765:x1877889758883840:12345-0@lo:501:mount.lustre.0 Request processed in 158us (361us total) trans 0 rc -2/-2 00000100:00100000:0.0:1790895579.201412:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1790895579.201471:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758883840:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1790895579.201482:0:15765:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.154@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1790895579.201601:0:15765:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.154@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1790895579.201607:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895579.201614:0:15765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91ca00/0x7911a98710cf96e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf96e7 expref: -99 pid: 14349 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895579.201636:0:15765:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8cf310c5e800 10000000:01000000:2.0:1790895579.201641:0:15765:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790895579.201645:0:15765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1790895579.201648:0:15765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790895579.201652:0:15765:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1790895579.201661:0:15765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1790895579.201683:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf337684600/0x7911a98710cf993a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895579.201691:0:15765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf337684600/0x7911a98710cf993a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895579.201701:0:15765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf337684600/0x7911a98710cf993a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895579.201713:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758883968:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1790895579.201739:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895579.201804:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3180dacc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.201949:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758883968 00000100:00100000:3.0:1790895579.201954:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758883968 00000100:00100000:2.0:1790895579.202016:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1790895579.202023:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:15765:x1877889758883968:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1790895579.202033:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895579.202045:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf337684a00/0x7911a98710cf9941 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf993a expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895579.202066:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf337684a00/0x7911a98710cf9941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf993a expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895579.202076:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf337684a00/0x7911a98710cf9941 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf993a expref: 17 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895579.202083:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684a00, rc 0) 00000100:00100000:2.0:1790895579.202122:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758883968:12345-0@lo:101:mount.lustre.0 Request processed in 100us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895579.202126:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1790895579.202209:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758883968:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895579.202218:0:15765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf337684600/0x7911a98710cf993a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9941 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.202224:0:15765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf337684600/0x7911a98710cf993a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9941 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790895579.202691:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1790895579.203412:0:15765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895579.203600:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1790895579.203628:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1790895579.203662:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1790895579.203714:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1790895579.203752:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1790895579.203797:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1790895579.203837:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1790895579.203842:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1790895579.203912:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895579.203946:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895579.203974:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b780 going to sleep for 11 seconds 00000100:00100000:2.0:1790895579.204050:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884096 00000100:00100000:2.0:1790895579.204057:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884096 00000100:00100000:2.0:1790895579.204078:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1790895579.204083:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884096:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1790895579.204381:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884096:12345-0@lo:501:mount.lustre.0 Request processed in 297us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895579.204386:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1790895579.205947:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884096:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895579.206033:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884224:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895579.206093:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895579.206141:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf336f3b780 going to sleep for 11 seconds 00000100:00100000:0.0:1790895579.206151:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884224 00000100:00100000:0.0:1790895579.206157:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884224 00000100:00100000:0.0:1790895579.206203:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1790895579.206211:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884224:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1790895579.206500:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884224:12345-0@lo:503:mount.lustre.0 Request processed in 289us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895579.206508:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1790895579.206522:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884224:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1790895579.207464:0:15765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1790895579.207523:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884352:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790895579.207561:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895579.207594:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3011cae40 going to sleep for 11 seconds 00000100:00100000:2.0:1790895579.207597:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884352 00000100:00100000:2.0:1790895579.207603:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884352 00000100:00100000:3.0:1790895579.207727:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1790895579.207738:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884352:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895579.207962:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884352:12345-0@lo:502:mount.lustre.0 Request processed in 226us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.207969:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1790895579.208045:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884352:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790895579.208245:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1790895579.208274:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1790895579.208290:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1790895579.208314:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1790895579.208332:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1790895579.208349:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1790895579.208373:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1790895579.208417:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1790895579.208462:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1790895579.208486:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884480:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790895579.208521:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895579.208559:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3011cae40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895579.208643:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884480 00000100:00100000:1.0:1790895579.208649:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884480 00000100:00100000:1.0:1790895579.208695:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1790895579.208704:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884480:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895579.208845:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884480:12345-0@lo:502:mount.lustre.0 Request processed in 143us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895579.208853:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1790895579.208983:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884480:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1790895579.209042:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1790895579.209052:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1790895579.209738:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1790895579.209746:0:15766:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1790895579.209751:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895579.209753:0:15766:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1790895579.209757:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1790895579.209769:0:15766:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8cf3417d19c0) 00000020:00000080:2.0:1790895579.209785:0:15766:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1790895579.209789:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1790895579.209833:0:15766:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf310c5e800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1790895579.209837:0:15766:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1790895579.209842:0:15766:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7911a98710cf994f 00010000:00010000:2.0:1790895579.212271:0:15766:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1790895579.212568:0:15766:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1790895579.213928:0:15766:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1790895579.215094:0:15766:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1790895579.215118:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895579.215125:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895579.215127:0:15766:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1790895579.215130:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895579.215133:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895579.215135:0:15766:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790895579.215137:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790895579.215145:0:15766:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1790895579.215148:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895579.215151:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895579.215152:0:15766:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1790895579.215154:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790895579.215157:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895579.215158:0:15766:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1790895579.215161:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1790895579.215211:0:15766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790895579.215214:0:15766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790895579.215216:0:15766:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1790895579.215219:0:15766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1790895579.215974:0:15765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1790895579.216008:0:15765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1790895579.216033:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf337684600/0x7911a98710cf993a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9941 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.216045:0:15765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf337684600/0x7911a98710cf993a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9941 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895579.216054:0:15765:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf310c5e800 from 1 10000000:01000000:0.0:1790895579.216056:0:15765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1790895579.216090:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.216098:0:15765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.216120:0:15765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895579.216146:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884608:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1790895579.216216:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895579.216273:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3011cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.216380:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884608 00000100:00100000:3.0:1790895579.216389:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884608 00000100:00100000:3.0:1790895579.216436:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1790895579.216447:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:15765:x1877889758884608:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895579.216460:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895579.216474:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9956 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.216498:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9956 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.216508:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9956 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.216516:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167ca00, rc 0) 00000100:00100000:3.0:1790895579.216562:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758884608:12345-0@lo:101:mount.lustre.0 Request processed in 116us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.216576:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1790895579.216697:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884608:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1790895579.216710:0:15765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.216720:0:15765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1790895579.217253:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1790895579.217529:0:15765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1790895579.217759:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1790895579.217799:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1790895579.217853:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1790895579.217889:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1790895579.217952:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884736:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1790895579.218002:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895579.218046:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3011cae40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.218221:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884736 00000100:00100000:3.0:1790895579.218231:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884736 00000100:00100000:3.0:1790895579.218282:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1790895579.218292:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758884736:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895579.218504:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758884736:12345-0@lo:501:mount.lustre.0 Request processed in 212us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.218511:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1790895579.218600:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884736:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895579.218635:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884864:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790895579.218673:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895579.218712:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.218757:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884864 00000100:00100000:3.0:1790895579.218761:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884864 00000100:00100000:3.0:1790895579.218792:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1790895579.218799:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758884864:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895579.219019:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201188050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758884864:12345-0@lo:503:mount.lustre.0 Request processed in 220us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.219027:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1790895579.219137:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884864:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790895579.219613:0:15765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790895579.219677:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884992:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895579.219720:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895579.219745:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1790895579.220329:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758884992 00000100:00100000:0.0:1790895579.220339:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758884992 00000100:00100000:0.0:1790895579.220473:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1790895579.220482:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758884992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1790895579.220708:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758884992:12345-0@lo:502:mount.lustre.0 Request processed in 227us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895579.220715:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1790895579.221392:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758884992:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790895579.221653:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1790895579.221706:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1790895579.221759:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1790895579.221798:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1790895579.221833:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1790895579.221905:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1790895579.221942:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1790895579.221995:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1790895579.222033:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885120:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895579.222093:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895579.222145:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.222288:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758885120 00000100:00100000:3.0:1790895579.222296:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758885120 00000100:00100000:3.0:1790895579.222333:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1790895579.222341:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758885120:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895579.222534:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758885120:12345-0@lo:502:mount.lustre.0 Request processed in 193us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.222541:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1790895579.222929:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885120:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790895579.223033:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1790895579.223043:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1790895579.224773:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895579.224784:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895579.224787:0:15770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1790895579.224794:0:15770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf310c5e800 00000020:00000080:1.0:1790895579.224796:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790895579.224804:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895579.224806:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895579.224808:0:15770:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1790895579.224810:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895579.224813:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895579.224815:0:15770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1790895579.224818:0:15770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8cf310c5e800 00000020:00000080:1.0:1790895579.224820:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790895579.224906:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895579.224910:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895579.224913:0:15770:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1790895579.224915:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790895579.224917:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895579.224918:0:15770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1790895579.224921:0:15770:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8cf310c5e800 00000020:00000080:1.0:1790895579.224923:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1790895579.224955:0:15770:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790895579.224958:0:15770:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790895579.224960:0:15770:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1790895579.224962:0:15770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1790895579.225307:0:15765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1790895579.225338:0:15765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790895579.225360:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.225389:0:15765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895579.225439:0:15765:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790895579.225442:0:15765:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8cf310c5e800 10000000:01000000:3.0:1790895579.225446:0:15765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8cf310c5e800 10000000:01000000:3.0:1790895579.225449:0:15765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790895579.225455:0:15765:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8cf310c5e800 from 1 10000000:01000000:3.0:1790895579.225458:0:15765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790895579.225494:0:15765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167d000/0x7911a98710cf9964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.225502:0:15765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf30167d000/0x7911a98710cf9964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.225512:0:15765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167d000/0x7911a98710cf9964 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895579.225536:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885248:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1790895579.225610:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895579.225905:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758885248 00000100:00100000:3.0:1790895579.225913:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758885248 00000100:00100000:3.0:1790895579.225955:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790895579.225964:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758885248:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895579.225978:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895579.225990:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167c200/0x7911a98710cf996b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9964 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.226023:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c200/0x7911a98710cf996b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9964 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.226033:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167c200/0x7911a98710cf996b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9964 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.226042:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c200, rc 0) 00000100:00100000:3.0:1790895579.226078:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885248:12345-0@lo:101:mount.lustre.0 Request processed in 115us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.226085:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1790895579.226150:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3187906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.226174:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885248:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1790895579.226187:0:15765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167d000/0x7911a98710cf9964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf996b expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.226196:0:15765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167d000/0x7911a98710cf9964 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf996b expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1790895579.227840:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1790895579.229293:0:15765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790895579.229603:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1790895579.229665:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1790895579.229702:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1790895579.229746:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1790895579.229783:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1790895579.229828:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1790895579.229895:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1790895579.229935:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1790895579.230000:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1790895579.230040:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1790895579.230076:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1790895579.230485:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1790895579.230526:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1790895579.230580:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1790895579.230631:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1790895579.230894:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1790895579.230929:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1790895579.230989:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1790895579.231027:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1790895579.231055:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1790895579.231097:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1790895579.231170:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1790895579.231202:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1790895579.231259:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1790895579.231295:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1790895579.231327:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1790895579.231376:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1790895579.231429:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1790895579.231466:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1790895579.231513:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1790895579.231550:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1790895579.231581:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1790895579.231610:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1790895579.231675:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1790895579.231712:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1790895579.231771:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1790895579.231811:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1790895579.231919:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1790895579.231927:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1790895579.232044:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895579.232128:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895579.232180:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3187906c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895579.232287:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758885376 00000100:00100000:1.0:1790895579.232319:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758885376 00000100:00100000:1.0:1790895579.232365:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1790895579.232374:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885376:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1790895579.232610:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885376:12345-0@lo:501:mount.lustre.0 Request processed in 237us (481us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895579.232618:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1790895579.232793:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885376:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1790895579.232826:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885504:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1790895579.237741:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895579.237809:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3187906c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.238286:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758885504 00000100:00100000:3.0:1790895579.238296:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758885504 00000100:00100000:3.0:1790895579.238362:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1790895579.238374:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885504:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1790895579.239093:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5db450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885504:12345-0@lo:503:mount.lustre.0 Request processed in 720us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.239113:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1790895579.239247:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e37b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885504:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1790895579.240045:0:15765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1790895579.240141:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895579.240190:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895579.240230:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31221b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895579.240544:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758885632 00000100:00100000:3.0:1790895579.240552:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758885632 00000100:00100000:3.0:1790895579.240609:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1790895579.240619:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885632:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1790895579.240933:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885632:12345-0@lo:502:mount.lustre.0 Request processed in 315us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895579.240940:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1790895579.241199:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790895579.241437:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1790895579.241484:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1790895579.241518:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1790895579.242148:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1790895579.242205:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1790895579.242263:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1790895579.242303:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1790895579.242341:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1790895579.242390:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1790895579.242446:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1790895579.242481:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1790895579.243809:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1790895579.243894:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1790895579.243933:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1790895579.243983:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1790895579.244018:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1790895579.244045:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1790895579.244097:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1790895579.244152:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1790895579.244184:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1790895579.244230:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1790895579.244266:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1790895579.244296:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1790895579.244341:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1790895579.244378:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1790895579.244435:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1790895579.244485:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1790895579.244521:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1790895579.244555:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1790895579.244600:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1790895579.244635:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1790895579.251228:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1790895579.251268:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1790895579.251348:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1790895579.251384:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1790895579.251434:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1790895579.251471:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1790895579.251506:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1790895579.251558:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1790895579.251610:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1790895579.251683:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895579.251762:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895579.251814:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758885760 00000100:00100000:1.0:1790895579.251821:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758885760 00000100:00100000:1.0:1790895579.251896:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790895579.251906:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1790895579.252137:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758885760:12345-0@lo:502:mount.lustre.0 Request processed in 232us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895579.252154:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1790895579.252210:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895579.252233:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758885760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1790895579.252295:0:15765:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1790895579.252304:0:15765:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1790895579.255272:0:15775:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1790895579.255287:0:15775:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8cf3417d4d40) 00000020:00000080:2.0:1790895579.255310:0:15775:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1790895579.255723:0:15775:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8cf310c5e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790895579.255728:0:15775:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8cf310c5e800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1790895579.255731:0:15775:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8cf310c5e800 3 00010000:00080000:2.0:1790895579.255761:0:15775:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8cf30d221000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.154@tcp at head 00010000:00010000:2.0:1790895579.263053:0:15775:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1790895579.266284:0:15775:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1790895579.266326:0:15775:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1790895579.266340:0:15775:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7911a98710cf9979 00000100:00080000:2.0:1790895579.266350:0:15775:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790895579.266362:0:15775:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8cf30d221000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895579.266398:0:15775:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf310111880 x1877889758885888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895579.266434:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758885888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1790895579.266500:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895579.266563:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758885888 00000100:00100000:2.0:1790895579.266577:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758885888 00000100:00100000:2.0:1790895579.266612:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790895579.266620:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3307:x1877889758885888:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1790895579.266645:0:14367:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1790895579.266676:0:14367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7911a98710cf9980 00000004:00100000:2.0:1790895579.266692:0:14367:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1790895579.266740:0:14367:0:(import.c:65:import_set_state_nolock()) ffff8cf2037b5800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895579.266791:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1877889758885888:12345-0@lo:38:llog_process_th.0 Request processed in 171us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895579.266798:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1790895579.266840:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310111880 x1877889758885888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790895589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895579.266852:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790895579.266893:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1790895579.266901:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1790895579.266905:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1790895579.266908:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf30d221000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1790895579.266914:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3307:1877889758885888:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1790895579.266932:0:15775:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1790895579.266985:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895579.266988:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790895579.266990:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895579.266994:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 450 00000100:00080000:2.0:1790895579.266998:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1790895579.267004:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf340fc7000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895579.267024:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf310112300 x1877889758886144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895579.267069:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895579.267078:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758886016:0@lo:400:kworker.0 00000100:00100000:2.0:1790895579.267122:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895579.267150:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758886272:0@lo:400:kworker.0 00000100:00100000:2.0:1790895579.267174:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895579.267192:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895579.267197:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758886400:0@lo:400:kworker.0 00000100:00100000:2.0:1790895579.267218:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895579.267245:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886272 00000100:00100000:2.0:1790895579.267249:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886272 00000100:00100000:2.0:1790895579.267288:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886400 00000100:00100000:2.0:1790895579.267291:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886400 00000100:00100000:2.0:1790895579.267316:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790895579.267322:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758886272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895579.267359:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310113480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1877889758886272:12345-0@lo:400:kworker.0 Request processed in 37us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895579.267366:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790895579.267377:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790895579.267383:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758886400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895579.267407:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1877889758886400:12345-0@lo:400:kworker.0 Request processed in 25us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895579.267413:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1790895579.267430:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790895579.267448:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310112a00 x1877889758886400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895579.267470:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3308:1877889758886400:0@lo:400:kworker.0 00010000:00080000:2.0:1790895579.267484:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8cf310110380 x1877889758886272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895579.267491:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310110380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3308:1877889758886272:0@lo:400:kworker.0 00000100:00100000:2.0:1790895579.267512:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758886144:0@lo:8:kworker.0 00000100:00100000:2.0:1790895579.267534:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895579.269842:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886016 00000100:00100000:0.0:1790895579.269896:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886016 00000100:00100000:0.0:1790895579.269949:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886144 00000100:00100000:0.0:1790895579.269953:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886144 00000100:00100000:0.0:1790895579.269970:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895579.269988:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758886016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895579.270069:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758886016:12345-0@lo:400:kworker.0 Request processed in 84us (2946us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895579.270076:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895579.270094:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790895579.270098:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1877889758886144:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1790895579.271796:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310110380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3307:x1877889758886144:12345-0@lo:8:kworker.0 Request processed in 1692us (4256us total) trans 0 rc -11/-11 00000100:00100000:0.0:1790895579.271808:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1790895579.271887:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895579.271929:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758886016:0@lo:400:kworker.0 00000100:00100000:3.0:1790895579.272336:0:3307:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1790895579.272344:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1790895579.272348:0:3307:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1790895579.272352:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758886144:0@lo:8:kworker.0 00000040:00080000:2.0:1790895579.272799:0:15775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1790895579.276074:0:15765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1790895579.276132:0:15765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1790895579.276776:0:15765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167d000/0x7911a98710cf9964 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf996b expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895579.276795:0:15765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf30167d000/0x7911a98710cf9964 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf996b expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1790895579.276925:0:15765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1790895579.276927:0:15765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790895579.276928:0:15765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895579.276929:0:15765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790895579.276931:0:15765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895579.276932:0:15765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895579.276934:0:15765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790895579.276936:0:15765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895579.276937:0:15765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790895579.276941:0:15765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1790895579.276943:0:15765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1790895579.276944:0:15765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790895579.276945:0:15765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895579.276946:0:15765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790895579.276947:0:15765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895579.276948:0:15765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895579.276950:0:15765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790895579.276951:0:15765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895579.276952:0:15765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1790895579.276980:0:15765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1790895579.277010:0:15765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758886528:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1790895579.277084:0:15765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895579.277148:0:15765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf318e659c0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895579.277220:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886528 00000100:00100000:2.0:1790895579.277228:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886528 00000100:00100000:2.0:1790895579.277280:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1790895579.277289:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:15765:x1877889758886528:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1790895579.277320:0:14359:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1790895579.277337:0:14359:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1790895579.299988:0:14359:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1790895579.300040:0:14359:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1790895579.300135:0:14383:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790895579.300140:0:14383:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790895579.300163:0:14383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.300199:0:14383:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf985a expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.300207:0:14383:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.300254:0:14383:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf985a expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895579.300271:0:14383:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf985a expref: 19 pid: 14361 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895579.300287:0:14383:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e35c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1877889758886656:0@lo:104: 00000100:00100000:3.0:1790895579.300360:0:14383:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895579.300410:0:14383:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861b600 going to sleep for 11 seconds 00000100:00100000:0.0:1790895579.300476:0:14350:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886656 00000100:00100000:0.0:1790895579.300484:0:14350:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886656 00000100:00100000:0.0:1790895579.300537:0:14350:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790895579.300547:0:14350:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14383:x1877889758886656:12345-0@lo:104: 00010000:00010000:0.0:1790895579.300561:0:14350:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.300624:0:14350:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1790895579.300631:0:14350:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:14383:x1877889758886656:12345-0@lo:104: Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895579.300637:0:14350:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1790895579.300662:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895579.300668:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.300674:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c600 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:0.0:1790895579.300687:0:14356:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.300696:0:14356:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1790895579.300704:0:14356:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1790895579.300710:0:14356:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1790895579.300740:0:14356:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.300747:0:14356:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1790895579.300767:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.300773:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf30167c600/0x7911a98710cf985a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9861 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.300790:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895579.300792:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895579.300794:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895579.300814:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758886784:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895579.300842:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895579.300914:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886784 00000100:00100000:0.0:1790895579.300918:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886784 00010000:00010000:0.0:1790895579.300935:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf985a expref: 20 pid: 14361 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895579.300956:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790895579.300970:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+20:3310:x1877889758886784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895579.300982:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895579.300987:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf985a expref: 20 pid: 14361 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.300997:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf985a expref: 20 pid: 14361 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301011:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301019:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1790895579.301030:0:14354:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001816094s 00010000:00010000:0.0:1790895579.301034:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301041:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301048:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301054:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301060:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167dc00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895579.301063:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301080:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301088:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895579.301097:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895579.301139:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+20:3310:x1877889758886784:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895579.301146:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1790895579.301180:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758886784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895579.301265:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7ce00/0x7911a98710cf9861 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf985a expref: 19 pid: 14361 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895579.301276:0:14383:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e35c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14383:1877889758886656:0@lo:104: 00010000:00010000:1.0:1790895579.301289:0:14383:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895579.301297:0:14383:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895579.301304:0:14383:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895579.301310:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9987 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895579.311628:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:15765:x1877889758886528:12345-0@lo:253:mount.lustre.0 Request processed in 34329us (34533us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895579.311645:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1790895579.312047:0:15765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:38adfb21-dafb-4eb3-8476-02ed33ee7efa:15765:1877889758886528:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1790895579.312063:0:15765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1790895579.312066:0:15765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1790895579.312068:0:15765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1790895579.312069:0:15765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1790895579.312070:0:15765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1790895579.312072:0:15765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1790895579.312073:0:15765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1790895579.312074:0:15765:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1790895579.312076:0:15765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1790895579.312077:0:15765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1790895579.312115:0:15765:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1790895579.322371:0:15765:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1790895579.322607:0:15765:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1790895579.322780:0:15765:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895579.324457:0:15765:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1790895579.324789:0:15765:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1790895579.325019:0:15765:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1790895579.326266:0:15765:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1790895579.435431:0:15765:0:(ofd_obd.c:541:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1790895579.435439:0:15765:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1790895579.435475:0:15765:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1790895579.435617:0:15765:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.154@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1790895579.435631:0:15765:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1790895579.435727:0:15765:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1790895579.932278:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790895580.507006:0:14364:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1790895580.507018:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8cf336887800 from 8 10000000:01000000:1.0:1790895580.507025:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1790895580.507099:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91cc00/0x7911a98710cf998e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895580.507114:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf33f91cc00/0x7911a98710cf998e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895580.507128:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf33f91cc00/0x7911a98710cf998e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895580.507163:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758886912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790895580.507254:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895580.507317:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33f8aed80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895580.507459:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758886912 00000100:00100000:2.0:1790895580.507470:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758886912 00000100:00100000:2.0:1790895580.507537:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1790895580.507549:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758886912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895580.507565:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895580.507605:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf337685800/0x7911a98710cf9995 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf998e expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895580.507634:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf337685800/0x7911a98710cf9995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf998e expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895580.507646:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf337685800/0x7911a98710cf9995 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf998e expref: 19 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895580.507656:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685800, rc 0) 00000100:00100000:2.0:1790895580.507712:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5db050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758886912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895580.507720:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1790895580.507986:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3397f2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758886912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895580.508005:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf33f91cc00/0x7911a98710cf998e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9995 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895580.508016:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91cc00/0x7911a98710cf998e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9995 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895580.508078:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758887040:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1790895580.508130:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895580.508156:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf307d62840 going to sleep for 11 seconds 00000100:00100000:2.0:1790895580.508316:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887040 00000100:00100000:2.0:1790895580.508332:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887040 00000100:00100000:2.0:1790895580.508361:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1790895580.508369:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758887040:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1790895580.508384:0:14359:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1790895580.508404:0:14359:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790895580.508408:0:14359:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1790895580.508505:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5da450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758887040:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895580.508512:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1790895580.508693:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758887040:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1790895580.508762:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790895580.508771:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf33f91cc00/0x7911a98710cf998e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9995 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895580.508791:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf33f91cc00/0x7911a98710cf998e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9995 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895580.953149:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895581.983782:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1790895582.281413:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1790895582.281470:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1790895583.003732:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895583.193218:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758887168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895583.193301:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895583.193542:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887168 00000100:00100000:3.0:1790895583.193551:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887168 00000100:00100000:3.0:1790895583.193718:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790895583.193729:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758887168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895583.193779:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895583.193834:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1877889758887168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895583.193841:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1790895583.193928:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1790895583.197983:0:3311:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1790895583.198026:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758887168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1790895584.031669:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1790895584.280589:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1790895584.728984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790895584.729005:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1790895584.729020:0:8:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1790895584.729039:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8cf340fc7000 using connection 192.168.201.154@tcp/0@lo 00000100:00100000:2.0:1790895584.729063:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8cf310112300 x1877889758887552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1790895584.729133:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758887296:0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.729214:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.730519:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758887936:0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.730574:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.730608:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1790895584.730615:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758887424:0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.730643:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.730681:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758887680:0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.730704:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.730721:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895584.730727:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758887808:0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.730750:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.730785:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887296 00000100:00100000:2.0:1790895584.730794:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887296 00000100:00100000:2.0:1790895584.730838:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790895584.730846:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3308:x1877889758887296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.730918:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5da050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3308:x1877889758887296:12345-0@lo:400:kworker.0 Request processed in 72us (1704us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895584.730925:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1790895584.730971:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887936 00000100:00100000:2.0:1790895584.730980:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887936 00000100:00100000:2.0:1790895584.731028:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887680 00000100:00100000:2.0:1790895584.731031:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887680 00000100:00100000:2.0:1790895584.731043:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887808 00000100:00100000:2.0:1790895584.731045:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887808 00000100:00100000:2.0:1790895584.731057:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790895584.731063:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758887936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.731097:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758887936:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895584.731103:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790895584.731115:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790895584.731121:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758887680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.731151:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758887680:12345-0@lo:400:kworker.0 Request processed in 30us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895584.731157:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1790895584.731167:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895584.731173:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758887808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.731198:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1877889758887808:12345-0@lo:400:kworker.0 Request processed in 26us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895584.731203:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895584.731220:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887424 00000100:00100000:2.0:1790895584.731223:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887424 00000100:00100000:2.0:1790895584.733729:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790895584.733756:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758887424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.733852:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758887424:12345-0@lo:400:kworker.0 Request processed in 110us (3207us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895584.733875:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1790895584.733957:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1790895584.734006:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf340659880 x1877889758887808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895584.734034:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3310:1877889758887808:0@lo:400:kworker.0 00010000:00080000:2.0:1790895584.734052:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf310111880 x1877889758887680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895584.734061:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310111880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758887680:0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.734110:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758887424:0@lo:400:kworker.0 00000100:00100000:2.0:1790895584.734121:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3308:1877889758887296:0@lo:400:kworker.0 00010000:00080000:2.0:1790895584.734133:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf34065b100 x1877889758887936/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790895600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790895584.734141:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758887936:0@lo:400:kworker.0 00000100:00100000:3.0:1790895584.741153:0:3307:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758887552:0@lo:8:kworker.0 00000100:00100000:3.0:1790895584.741277:0:3307:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.742439:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758887552 00000100:00100000:2.0:1790895584.742455:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758887552 00000100:00100000:2.0:1790895584.742512:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790895584.742522:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3307:x1877889758887552:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1790895584.742571:0:15052:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:2.0:1790895584.742607:0:15052:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7911a98710cf999c 00002000:00100000:2.0:1790895584.742621:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8cf2037b1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a3f ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1790895584.742626:0:15052:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1790895584.742629:0:15052:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1790895584.743051:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790895584.743084:0:15052:0:(import.c:65:import_set_state_nolock()) ffff8cf2037b4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895584.743171:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1877889758887552:12345-0@lo:8:kworker.0 Request processed in 648us (1893us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895584.743190:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1790895584.743525:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf310112300 x1877889758887552/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1790895609 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1790895584.743556:0:3307:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1790895584.743565:0:3307:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1790895584.743572:0:3307:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1790895584.743574:0:3307:0:(import.c:65:import_set_state_nolock()) ffff8cf340fc7000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1790895584.743601:0:3307:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1790895584.743607:0:3307:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3307:1877889758887552:0@lo:8:kworker.0 00000004:00080000:3.0:1790895584.745045:0:14391:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1790895584.746128:0:14391:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 457713268011ns, next at 0ns, rc = 0 00000004:00080000:2.0:1790895584.746723:0:14392:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1790895584.746752:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1877889758888192:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790895584.746826:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.746879:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31001c480 going to sleep for 11 seconds 00000100:00100000:2.0:1790895584.746918:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888192 00000100:00100000:2.0:1790895584.746926:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888192 00000100:00100000:2.0:1790895584.746980:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790895584.746989:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14392:x1877889758888192:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1790895584.747461:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758888064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895584.747502:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895584.747546:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888064 00000100:00100000:3.0:1790895584.747551:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888064 00000100:00100000:3.0:1790895584.747577:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1790895584.747585:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877889758888064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1790895584.747611:0:15054:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1790895584.747655:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1877889758888064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895584.747662:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1790895584.747705:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8cf34065b100 x1877889758888064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1790895600 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790895584.747723:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758888064:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1790895584.747763:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:3.0:1790895584.763769:0:15051:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1790895584.763784:0:15051:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1790895584.763790:0:15051:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1790895584.775232:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.775248:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.775267:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.775271:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.775279:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.775299:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.775309:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.775316:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.776330:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790895584.777402:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.777414:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777429:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.777434:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.777440:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777468:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777480:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777489:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777508:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790895584.777521:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790895584.777527:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777535:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167dc00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.777541:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777551:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777569:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777578:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf99a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777609:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.777613:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777620:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167da00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.777623:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777632:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777644:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777652:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf99aa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.777666:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.777669:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.777671:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.779561:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790895584.790081:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.790098:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.790119:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.790132:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.790139:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.790155:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.790166:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.790173:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.790202:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.793440:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.793457:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.793471:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.793477:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.793489:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.793524:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.793532:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf99b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.793573:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.793574:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.793576:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790895584.794201:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.794212:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.794227:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.794232:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.794239:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.794253:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.794262:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.794278:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.794297:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790895584.794310:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.794316:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.794325:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.796887:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.796908:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.796931:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.796939:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf99b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.796967:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.796970:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.796972:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.797382:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.797989:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.798019:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.798026:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.798033:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.798052:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.798065:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.798073:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.798101:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790895584.799463:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.799486:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.799501:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.799506:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.799518:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.799539:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.799548:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000990c649/0x7911a98710cf99bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.799573:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.799575:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.799577:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.802364:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.802378:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.802455:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.802459:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.802466:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.802479:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.802488:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.802494:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.802556:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790895584.803068:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.803076:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.803088:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.803091:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.803095:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.803106:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.803122:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.803127:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.803138:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1790895584.804034:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1790895584.804044:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804055:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91da00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.804060:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804081:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804100:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804108:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000dc1d1a/0x7911a98710cf99c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804127:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.804131:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804138:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.804141:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804148:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804157:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804163:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063bb6153/0x7911a98710cf99cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.804189:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.804191:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.804194:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.804201:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.806295:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.806306:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806320:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.806324:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.806330:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806341:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806348:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806354:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806381:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790895584.806412:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.806422:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806442:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.806446:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806456:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806474:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806482:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ff60a14/0x7911a98710cf99d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806619:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.806624:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.806628:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.806797:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.806802:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806808:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.806810:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.806813:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806819:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806824:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806828:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.806845:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790895584.806906:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.806912:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806928:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.806932:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806941:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806954:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806962:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088fbf34a/0x7911a98710cf99db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.806978:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.806982:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.806985:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.807381:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.807385:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807570:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.807578:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.807582:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807589:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807595:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807599:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807616:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1790895584.807928:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.807934:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807942:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.807944:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.807948:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807958:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807966:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807980:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.807994:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1790895584.808333:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.808338:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808344:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.808346:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.808348:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808354:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808359:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808364:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808368:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1790895584.808690:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.808694:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808703:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.808705:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.808708:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808714:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808719:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808724:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.808728:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:0.0:1790895584.809112:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1790895584.809119:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809130:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895584.809133:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809139:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809152:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809156:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000033ee004e/0x7911a98710cf99e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809170:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1790895584.809172:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809176:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895584.809178:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809182:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809186:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809195:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040822c1e/0x7911a98710cf99e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809204:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1790895584.809206:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809211:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895584.809214:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809221:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809230:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809237:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5b0cddf/0x7911a98710cf99f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809259:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895584.809262:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809269:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895584.809276:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809281:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809289:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809293:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6616675/0x7911a98710cf99f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.809300:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895584.809301:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895584.809302:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.809704:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.810947:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.810958:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.810969:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.810972:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.810976:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.810985:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811001:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811006:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811034:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.811052:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.811058:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811065:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.811070:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811079:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811094:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811101:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014f04989/0x7911a98710cf99fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811116:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.811124:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.811125:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.811636:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.811643:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811651:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.811655:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.811659:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811670:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811678:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811686:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811701:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.811710:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.811714:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811721:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.811725:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811744:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811755:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811763:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a05 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.811776:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.811777:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.811779:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.812191:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.812198:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812207:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.812211:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.812215:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812225:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812234:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812247:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812261:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.812271:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.812275:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812281:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55e00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.812285:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812293:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812304:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812310:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000407e169b/0x7911a98710cf9a0c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812321:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.812323:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.812325:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.812688:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.812701:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812709:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.812712:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.812717:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812726:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812733:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812741:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812755:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.812764:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.812768:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812775:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54800 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.812778:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812787:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812803:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812810:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7d3fed4/0x7911a98710cf9a13 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.812824:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.812826:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.812828:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.813233:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.813239:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813247:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.813250:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.813255:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813265:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813273:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813282:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813305:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.813314:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.813318:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813325:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.813328:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813337:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813348:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813356:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d260e2b/0x7911a98710cf9a1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813368:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.813369:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.813371:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.813725:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.813731:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813740:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.813748:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.813753:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813763:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813772:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813780:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813793:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.813803:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.813806:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813813:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54a00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.813817:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813825:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813836:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813854:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087a2cb84/0x7911a98710cf9a21 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.813894:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.813895:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.813897:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.817409:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.817424:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817444:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.817449:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.817456:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817471:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817482:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817490:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817514:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1790895584.817527:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.817538:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817546:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.817551:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817560:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817577:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817584:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efcde858/0x7911a98710cf9a28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.817603:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.817604:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.817606:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1790895584.818421:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1790895584.818481:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.818489:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.818574:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.818578:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.818583:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.818606:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.818617:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.818626:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.818648:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790895584.818884:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.818962:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.818972:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.818976:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.818998:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819025:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819034:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8baa030/0x7911a98710cf9a2f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819050:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.819052:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.819054:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.819080:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.819085:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.819093:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.819097:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.819101:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.819109:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.819117:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.819136:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.819160:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790895584.819474:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.819480:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819488:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.819492:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819571:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819584:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819603:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000161458ff/0x7911a98710cf9a36 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.819617:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.819619:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.819620:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1790895584.819972:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1790895584.819979:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.819988:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=457s v=(0 0) 00010000:00010000:1.0:1790895584.819992:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895584.819996:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.820006:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.820025:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.820033:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.820045:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1790895584.821372:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1790895584.821458:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.821474:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54e00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:3.0:1790895584.821479:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.821491:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.821590:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.821599:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbf8a08a/0x7911a98710cf9a3d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.821628:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.821630:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.821631:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1790895584.822978:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.822990:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.823006:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.823020:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.823026:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.823041:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.823052:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.823059:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.823123:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1790895584.824100:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.824109:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.824121:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.824125:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.824130:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.824152:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.824162:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.824170:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824703:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1790895584.824713:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824729:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167de00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.824734:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824744:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824763:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824771:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008859f19e/0x7911a98710cf9a44 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824794:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.824798:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824805:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167da00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.824808:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824816:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824826:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.824839:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.824841:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.824843:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.824989:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790895584.824996:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000981006e7/0x7911a98710cf9a4b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895584.825695:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.825702:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.825713:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.825717:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.825722:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.825735:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.825756:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.825765:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.825988:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.825996:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.826004:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167dc00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.826018:0:14355:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.826026:0:14355:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.826040:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.826048:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.826050:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.826052:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1790895584.826365:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790895584.826371:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5eb747d/0x7911a98710cf9a52 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895584.827790:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.827802:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.827817:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.827843:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.827849:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.827898:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.827908:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.827927:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.829363:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895584.829378:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.829401:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895584.829405:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.829417:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895584.829441:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.829638:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1790895584.829645:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a6e4725/0x7911a98710cf9a59 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1790895584.830515:0:15051:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1790895584.830523:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.830537:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1790895584.830542:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895584.830549:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.830563:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.830574:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.830582:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895584.830602:0:15051:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1790895584.830771:0:15051:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:3.0:1790895584.830898:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14392:x1877889758888192:12345-0@lo:5:osp-pre-1-0.0 Request processed in 83906us (84068us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895584.830913:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790895584.831158:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1877889758888192:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790895584.831175:0:14392:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1790895584.831286:0:14392:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1877889758888320:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1790895584.831320:0:14392:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895584.831369:0:14392:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31001c480 going to sleep for 11 seconds 00000100:00100000:3.0:1790895584.831909:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888320 00000100:00100000:3.0:1790895584.831918:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888320 00000100:00100000:3.0:1790895584.831958:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790895584.831966:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14392:x1877889758888320:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1790895584.832017:0:15049:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1790895584.833797:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1790895584.833809:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.833823:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167c600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895584.833828:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.833847:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.833884:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.833893:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb2f02d/0x7911a98710cf9a60 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895584.833916:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.833918:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.833921:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895584.833932:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895584.840301:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14392:x1877889758888320:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8327us (8971us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790895584.840315:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1790895584.840634:0:14392:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14392:1877889758888320:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1790895584.840649:0:14392:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:1.0:1790895585.049745:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790895585.573640:0:16122:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg154-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1790895586.077875:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895587.098113:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895587.510278:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895587.510532:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741069568 00000100:00100000:3.0:1790895587.510544:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741069568 00000100:00100000:3.0:1790895587.510596:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 75 00000100:00100000:3.0:1790895587.510605:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf32a5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2360:x1877889741069568:12345-192.168.201.54@tcp:250:mount.lustre.0 00010000:00080000:3.0:1790895587.510637:0:14361:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 68072c20-598b-412d-9027-10e9da026c3e@192.168.201.54@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:3.0:1790895587.510670:0:14361:0:(genops.c:1384:class_connect()) connect: client 68072c20-598b-412d-9027-10e9da026c3e, cookie 0x7911a98710cf9a67 00000100:00080000:3.0:1790895587.510828:0:14361:0:(import.c:65:import_set_state_nolock()) ffff8cf303070800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1790895587.511214:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf32a5d9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+5:2360:x1877889741069568:12345-192.168.201.54@tcp:250:mount.lustre.0 Request processed in 606us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895587.511222:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 75 00000100:00100000:0.0:1790895587.513651:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.513732:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741069696 00000100:00100000:2.0:1790895587.513744:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741069696 00000100:00100000:2.0:1790895587.513800:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 76 00000100:00100000:2.0:1790895587.513810:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+5:13736:x1877889741069696:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790895587.513827:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895587.513846:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf337685000/0x7911a98710cf9a6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc3079 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.513930:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf337685000/0x7911a98710cf9a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3079 expref: 6 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.513942:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf337685000/0x7911a98710cf9a6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3079 expref: 6 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.513951:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685000, rc 0) 00000100:00100000:2.0:1790895587.514019:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+6:13736:x1877889741069696:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 201us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895587.514026:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 76 00000100:00100000:0.0:1790895587.518934:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895587.518985:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741069824 00000100:00100000:3.0:1790895587.518997:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741069824 00000100:00100000:3.0:1790895587.519187:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 77 00000100:00100000:3.0:1790895587.519197:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+6:13736:x1877889741069824:12345-192.168.201.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790895587.519603:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+6:13736:x1877889741069824:12345-192.168.201.54@tcp:501:mount.lustre.0 Request processed in 406us (752us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790895587.519612:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 77 00000100:00100000:0.0:1790895587.523557:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.523683:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741069952 00000100:00100000:2.0:1790895587.523695:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741069952 00000100:00100000:2.0:1790895587.523758:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:2.0:1790895587.523768:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+6:13736:x1877889741069952:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790895587.523784:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895587.523801:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf337684e00/0x7911a98710cf9a75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc3080 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.523830:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf337684e00/0x7911a98710cf9a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3080 expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.523841:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf337684e00/0x7911a98710cf9a75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3080 expref: 7 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.523849:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684e00, rc 0) 00000100:00100000:2.0:1790895587.523931:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+7:13736:x1877889741069952:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 164us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895587.523954:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 78 00000100:00100000:0.0:1790895587.528289:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895587.528406:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070080 00000100:00100000:3.0:1790895587.528417:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070080 00000100:00100000:3.0:1790895587.528506:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 79 00000100:00100000:3.0:1790895587.528517:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+7:13736:x1877889741070080:12345-192.168.201.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790895587.528809:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+8:13736:x1877889741070080:12345-192.168.201.54@tcp:501:mount.lustre.0 Request processed in 294us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895587.528818:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 79 00000100:00100000:0.0:1790895587.536765:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895587.536822:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070208 00000100:00100000:1.0:1790895587.536832:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070208 00000100:00100000:1.0:1790895587.536922:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 80 00000100:00100000:1.0:1790895587.536933:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+8:13736:x1877889741070208:12345-192.168.201.54@tcp:503:mount.lustre.0 00000100:00100000:0.0:1790895587.537366:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+8:13736:x1877889741070208:12345-192.168.201.54@tcp:503:mount.lustre.0 Request processed in 433us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.537375:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 80 00000100:00100000:0.0:1790895587.544366:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895587.544607:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070336 00000100:00100000:3.0:1790895587.544618:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070336 00000100:00100000:3.0:1790895587.544672:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 81 00000100:00100000:3.0:1790895587.544682:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+8:13754:x1877889741070336:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:3.0:1790895587.544981:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+8:13754:x1877889741070336:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 299us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895587.544990:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 81 00000100:00100000:3.0:1790895587.578031:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895587.578139:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070464 00000100:00100000:0.0:1790895587.578150:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070464 00000100:00100000:0.0:1790895587.578212:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 82 00000100:00100000:0.0:1790895587.578222:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+8:13754:x1877889741070464:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790895587.578670:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+8:13754:x1877889741070464:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 448us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.578678:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 82 00000100:00100000:0.0:1790895587.590258:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.590605:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070592 00000100:00100000:2.0:1790895587.590616:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070592 00000100:00100000:2.0:1790895587.590669:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 83 00000100:00100000:2.0:1790895587.590679:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+8:13736:x1877889741070592:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:2.0:1790895587.590783:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895587.590802:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf337684200/0x7911a98710cf9a7c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc30aa expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.590831:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf337684200/0x7911a98710cf9a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30aa expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.590843:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf337684200/0x7911a98710cf9a7c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30aa expref: 9 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895587.590852:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684200, rc 0) 00000100:00100000:2.0:1790895587.591007:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+9:13736:x1877889741070592:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 328us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895587.591014:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 83 00000100:00100000:2.0:1790895587.595939:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895587.596038:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070720 00000100:00100000:0.0:1790895587.596050:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070720 00000100:00100000:0.0:1790895587.596108:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:0.0:1790895587.596120:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+9:13736:x1877889741070720:12345-192.168.201.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790895587.596148:0:14362:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790895587.596174:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790895587.596182:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790895587.596186:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790895587.596188:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790895587.598336:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+9:13736:x1877889741070720:12345-192.168.201.54@tcp:256:mount.lustre.0 Request processed in 2208us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.598350:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 84 00000100:00100000:1.0:1790895587.601083:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895587.601189:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070848 00000100:00100000:3.0:1790895587.601267:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070848 00000100:00100000:3.0:1790895587.601375:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 85 00000100:00100000:3.0:1790895587.601387:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+9:13736:x1877889741070848:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790895587.601405:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895587.601437:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc30b1 expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.601480:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.601493:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 10 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.601502:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c400, rc 0) 00000100:00100000:3.0:1790895587.601562:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340fd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+10:13736:x1877889741070848:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 177us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895587.601570:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 85 00000100:00100000:2.0:1790895587.603937:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895587.604027:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741070976 00000100:00100000:0.0:1790895587.604037:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741070976 00000100:00100000:0.0:1790895587.604081:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 86 00000100:00100000:0.0:1790895587.604090:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+10:13736:x1877889741070976:12345-192.168.201.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790895587.604406:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+10:13736:x1877889741070976:12345-192.168.201.54@tcp:501:mount.lustre.0 Request processed in 316us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.604413:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 86 00000100:00100000:1.0:1790895587.606521:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895587.606653:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741071104 00000100:00100000:3.0:1790895587.606664:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741071104 00000100:00100000:3.0:1790895587.606730:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 87 00000100:00100000:3.0:1790895587.606741:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf31813b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+10:13736:x1877889741071104:12345-192.168.201.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790895587.607005:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf31813b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+10:13736:x1877889741071104:12345-192.168.201.54@tcp:503:mount.lustre.0 Request processed in 265us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895587.607013:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 87 00000100:00100000:1.0:1790895587.610168:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.610254:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741071232 00000100:00100000:2.0:1790895587.610266:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741071232 00000100:00100000:2.0:1790895587.610320:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 88 00000100:00100000:2.0:1790895587.610331:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+10:13758:x1877889741071232:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790895587.610609:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318138050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+10:13758:x1877889741071232:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 278us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895587.610627:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 88 00000100:00100000:2.0:1790895587.622390:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895587.622485:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741071360 00000100:00100000:0.0:1790895587.622496:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741071360 00000100:00100000:0.0:1790895587.622544:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 89 00000100:00100000:0.0:1790895587.622553:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf31813b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+10:13758:x1877889741071360:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790895587.622781:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf31813b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+10:13758:x1877889741071360:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 228us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.622789:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 89 00000100:00100000:1.0:1790895587.635737:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.635890:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741071488 00000100:00100000:2.0:1790895587.635900:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741071488 00000100:00100000:2.0:1790895587.635944:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:2.0:1790895587.635951:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2360:x1877889741071488:12345-192.168.201.54@tcp:38:mount.lustre.0 00010000:00080000:2.0:1790895587.635988:0:14369:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from a3a9f9f0-10b2-41f5-96b5-b7728332a4f3@192.168.201.54@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:2.0:1790895587.636028:0:14369:0:(genops.c:1384:class_connect()) connect: client a3a9f9f0-10b2-41f5-96b5-b7728332a4f3, cookie 0x7911a98710cf9a8a 00000004:00100000:2.0:1790895587.636054:0:14369:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1790895587.636059:0:14369:0:(tgt_lastrcvd.c:728:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:1.0:1790895587.664503:0:14369:0:(import.c:65:import_set_state_nolock()) ffff8cf336dc3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1790895587.664608:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2360:x1877889741071488:12345-192.168.201.54@tcp:38:mount.lustre.0 Request processed in 28654us (28877us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895587.664619:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:1.0:1790895587.666771:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895587.666826:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.667015:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741071744 00000100:00100000:2.0:1790895587.667024:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741071744 00000100:00080000:0.0:1790895587.667073:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1790895587.667086:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741071616 00000100:00100000:2.0:1790895587.667089:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741071616 00000100:00100000:2.0:1790895587.667113:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1790895587.667122:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:2.0:1790895587.667123:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:13736:x1877889741071744:12345-192.168.201.54@tcp:41:mount.lustre.0 00000100:00100000:0.0:1790895587.667129:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:0:x1877889741071616:12345-192.168.201.54@tcp:41:mount.lustre.0 00000004:00000024:2.0:1790895587.667165:0:14368:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1790895587.667244:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:13736:x1877889741071744:12345-192.168.201.54@tcp:41:mount.lustre.0 Request processed in 120us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895587.667251:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000004:00000024:0.0:1790895587.667476:0:14369:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790895587.667519:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:0:x1877889741071616:12345-192.168.201.54@tcp:41:mount.lustre.0 Request processed in 390us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.667555:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:1.0:1790895587.669619:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.669762:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741071872 00000100:00100000:2.0:1790895587.669770:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741071872 00000100:00100000:2.0:1790895587.669812:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:2.0:1790895587.669819:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13736:x1877889741071872:12345-192.168.201.54@tcp:40:mount.lustre.0 00000100:00100000:2.0:1790895587.670002:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13736:x1877889741071872:12345-192.168.201.54@tcp:40:mount.lustre.0 Request processed in 183us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895587.670019:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:2.0:1790895587.672922:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.673014:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895587.673048:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895587.673123:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072000 00000100:00100000:0.0:1790895587.673133:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072000 00000100:00100000:0.0:1790895587.673174:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072128 00000100:00100000:0.0:1790895587.673178:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072128 00000100:00100000:0.0:1790895587.673191:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1790895587.673200:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1877889741072000:12345-192.168.201.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790895587.673242:0:15052:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from a3a9f9f0-10b2-41f5-96b5-b7728332a4f3@192.168.201.54@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1790895587.673272:0:15052:0:(genops.c:1384:class_connect()) connect: client a3a9f9f0-10b2-41f5-96b5-b7728332a4f3, cookie 0x7911a98710cf9a91 00002000:00100000:0.0:1790895587.673284:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a3a9f9f0-10b2-41f5-96b5-b7728332a4f3/ffff8cf3371fb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790895587.673306:0:15052:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790895587.673634:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1790895587.673667:0:15052:0:(import.c:65:import_set_state_nolock()) ffff8cf318f0a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895587.673750:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2360:x1877889741072000:12345-192.168.201.54@tcp:8:mount.lustre.0 Request processed in 550us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.673758:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1790895587.673775:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:0.0:1790895587.673779:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2360:x1877889741072128:12345-192.168.201.54@tcp:8:mount.lustre.0 00010000:00080000:0.0:1790895587.673795:0:15052:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from a3a9f9f0-10b2-41f5-96b5-b7728332a4f3@192.168.201.54@tcp t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:0.0:1790895587.673811:0:15052:0:(genops.c:1384:class_connect()) connect: client a3a9f9f0-10b2-41f5-96b5-b7728332a4f3, cookie 0x7911a98710cf9a98 00002000:00100000:0.0:1790895587.673816:0:15052:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a3a9f9f0-10b2-41f5-96b5-b7728332a4f3/ffff8cf318f0a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1790895587.673831:0:15052:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1790895587.673993:0:15052:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1790895587.674013:0:15052:0:(import.c:65:import_set_state_nolock()) ffff8cf310c5b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895587.674052:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2360:x1877889741072128:12345-192.168.201.54@tcp:8:mount.lustre.0 Request processed in 270us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895587.674059:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:1.0:1790895587.674780:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072256 00000100:00100000:1.0:1790895587.674788:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072256 00000100:00100000:1.0:1790895587.674889:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:1.0:1790895587.674899:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13736:x1877889741072256:12345-192.168.201.54@tcp:33:mount.lustre.0 00000004:00080000:2.0:1790895587.676782:0:14370:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1826us 00000004:00200000:2.0:1790895587.686737:0:14370:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1790895587.686887:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13736:x1877889741072256:12345-192.168.201.54@tcp:33:mount.lustre.0 Request processed in 11959us (13943us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895587.686904:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:2.0:1790895587.843280:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895587.843373:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072384 00000100:00100000:3.0:1790895587.843383:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072384 00000100:00100000:3.0:1790895587.843439:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:3.0:1790895587.843450:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13779:x1877889741072384:12345-192.168.201.54@tcp:101:mkdir.0 00010000:00010000:3.0:1790895587.843471:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895587.843496:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf9a9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc30db expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.843577:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf9aa6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.843590:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf9aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.843605:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf9aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895587.843660:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790895587.843664:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895587.843715:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf9aa6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.843739:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167dc00/0x7911a98710cf9a9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30db expref: 8 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.843769:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf9aa6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30db expref: 7 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895587.845476:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895587.845486:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895587.845492:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167da00, rc 0) 00000100:00100000:3.0:1790895587.845571:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:13779:x1877889741072384:12345-192.168.201.54@tcp:101:mkdir.0 Request processed in 2120us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895587.845580:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00010000:00010000:1.0:1790895588.120122:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895588.313279:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758888448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1790895588.313351:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895588.313502:0:15054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888448 00000100:00100000:3.0:1790895588.313511:0:15054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888448 00000100:00100000:3.0:1790895588.313592:0:15054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790895588.313601:0:15054:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758888448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1790895588.313625:0:15054:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1790895588.313689:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895588.314066:0:15054:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758888448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 465us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895588.314074:0:15054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790895588.314250:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758888448:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1790895589.145114:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895589.697526:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895589.698199:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072512 00000100:00100000:0.0:1790895589.698211:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072512 00000100:00080000:3.0:1790895589.698439:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895589.698638:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:0.0:1790895589.698654:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:13832:x1877889741072512:12345-192.168.201.54@tcp:41:lfs.0 00000004:00000024:0.0:1790895589.698700:0:15620:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1790895589.698832:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:13832:x1877889741072512:12345-192.168.201.54@tcp:41:lfs.0 Request processed in 183us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.699535:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:1.0:1790895589.712635:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895589.716266:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072640 00000100:00100000:0.0:1790895589.716287:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072640 00000100:00100000:0.0:1790895589.716392:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:0.0:1790895589.716416:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13832:x1877889741072640:12345-192.168.201.54@tcp:13:lfs.0 00002000:00000024:0.0:1790895589.716457:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895589.716559:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13832:x1877889741072640:12345-192.168.201.54@tcp:13:lfs.0 Request processed in 158us (3936us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.716567:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00080000:3.0:1790895589.716744:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895589.721767:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895589.721938:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072768 00000100:00100000:0.0:1790895589.721948:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072768 00000100:00100000:0.0:1790895589.722018:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1790895589.722029:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13832:x1877889741072768:12345-192.168.201.54@tcp:13:lfs.0 00002000:00000024:0.0:1790895589.722071:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895589.722162:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:13832:x1877889741072768:12345-192.168.201.54@tcp:13:lfs.0 Request processed in 134us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.722182:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00080000:3.0:1790895589.722284:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1790895589.851257:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895589.851282:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758888576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895589.851353:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895589.851614:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758889088:0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.851650:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895589.851685:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1790895589.851692:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758888960:0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.851716:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895589.851744:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889088 00000100:00100000:0.0:1790895589.851752:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889088 00000100:00100000:0.0:1790895589.851808:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888960 00000100:00100000:0.0:1790895589.851812:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888960 00000100:00100000:0.0:1790895589.851836:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790895589.851844:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758889088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.851920:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758889088:12345-0@lo:400:kworker.0 Request processed in 77us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.851959:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1790895589.851976:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790895589.851983:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758888960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.852011:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1877889758888960:12345-0@lo:400:kworker.0 Request processed in 30us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.852017:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1790895589.852052:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3311:1877889758888960:0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.852063:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758889088:0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.852091:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888576 00000100:00100000:0.0:1790895589.852094:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888576 00000100:00100000:0.0:1790895589.852121:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790895589.852142:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758888576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895589.852159:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895589.852189:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1877889758888576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.852195:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1790895589.852270:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758888832:0@lo:400:kworker.0 00000100:00100000:1.0:1790895589.852303:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895589.852332:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1790895589.852339:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758888704:0@lo:400:kworker.0 00000100:00100000:1.0:1790895589.852365:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895589.852390:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758889216:0@lo:400:kworker.0 00000100:00100000:1.0:1790895589.852416:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895589.852604:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758888576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895589.852625:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889216 00000100:00100000:2.0:1790895589.852628:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889216 00000100:00100000:2.0:1790895589.852662:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790895589.852669:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758889216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895589.852706:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1877889758889216:12345-0@lo:400:kworker.0 Request processed in 37us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895589.852712:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1790895589.852748:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3309:1877889758889216:0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.852874:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888832 00000100:00100000:0.0:1790895589.852879:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888832 00000100:00100000:0.0:1790895589.852961:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790895589.852970:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758888832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895589.853018:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758888832:12345-0@lo:400:kworker.0 Request processed in 50us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.853024:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1790895589.853080:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758888832:0@lo:400:kworker.0 00000100:00100000:3.0:1790895589.854953:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758888704 00000100:00100000:3.0:1790895589.854983:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758888704 00000100:00100000:3.0:1790895589.855037:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1790895589.855048:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3309:x1877889758888704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1790895589.855133:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318138c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3309:x1877889758888704:12345-0@lo:400:kworker.0 Request processed in 88us (2766us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895589.855139:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1790895589.855170:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1790895589.855176:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895589.855205:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758888704:0@lo:400:kworker.0 00000001:00100000:3.0:1790895589.940116:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a3a9f9f0-10b2-41f5-96b5-b7728332a4f3 00000001:00100000:3.0:1790895589.940157:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1790895589.940167:0:7641:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:2.0:1790895589.947044:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895589.947431:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741072896 00000100:00100000:0.0:1790895589.947445:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741072896 00000100:00100000:0.0:1790895589.947514:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 91 00000100:00100000:0.0:1790895589.947526:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+10:13862:x1877889741072896:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790895589.947546:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895589.947567:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf9aad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc30e2 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895589.947604:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf9aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30e2 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895589.947616:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7c800/0x7911a98710cf9aad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30e2 expref: 11 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895589.947626:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c800, rc 0) 00000100:00100000:0.0:1790895589.947694:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+11:13862:x1877889741072896:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 170us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.947714:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 91 00000100:00100000:2.0:1790895589.960250:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895589.960341:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073024 00000100:00100000:3.0:1790895589.960351:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073024 00000100:00100000:3.0:1790895589.960406:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 92 00000100:00100000:3.0:1790895589.960417:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+11:13862:x1877889741073024:12345-192.168.201.54@tcp:501:mount.lustre.0 00000100:00100000:3.0:1790895589.960756:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+11:13862:x1877889741073024:12345-192.168.201.54@tcp:501:mount.lustre.0 Request processed in 340us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895589.960764:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 92 00000100:00100000:2.0:1790895589.967401:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895589.967484:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073152 00000100:00100000:3.0:1790895589.967496:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073152 00000100:00100000:3.0:1790895589.967557:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 93 00000100:00100000:3.0:1790895589.967568:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+11:13862:x1877889741073152:12345-192.168.201.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790895589.967933:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318138850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+11:13862:x1877889741073152:12345-192.168.201.54@tcp:503:mount.lustre.0 Request processed in 357us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895589.967942:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 93 00000100:00100000:3.0:1790895589.987646:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895589.987750:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073280 00000100:00100000:0.0:1790895589.987760:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073280 00000100:00100000:0.0:1790895589.987814:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 94 00000100:00100000:0.0:1790895589.987823:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+11:13871:x1877889741073280:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790895589.988248:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318139c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+11:13871:x1877889741073280:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 425us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895589.988257:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 94 00000100:00100000:2.0:1790895590.006992:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895590.007093:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073408 00000100:00100000:0.0:1790895590.007105:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073408 00000100:00100000:0.0:1790895590.007168:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 95 00000100:00100000:0.0:1790895590.007179:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+11:13871:x1877889741073408:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:0.0:1790895590.007568:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dab850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+11:13871:x1877889741073408:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 390us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895590.007578:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 95 00000100:00100000:2.0:1790895590.014393:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895590.014634:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073536 00000100:00100000:3.0:1790895590.014646:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073536 00000100:00100000:3.0:1790895590.014701:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 96 00000100:00100000:3.0:1790895590.014711:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+11:13862:x1877889741073536:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:3.0:1790895590.014728:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895590.014745:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9ab4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc310c expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895590.014775:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc310c expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895590.014785:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167dc00/0x7911a98710cf9ab4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc310c expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895590.014794:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167dc00, rc 0) 00000100:00100000:3.0:1790895590.014917:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+12:13862:x1877889741073536:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 207us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895590.014934:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 96 00000100:00100000:3.0:1790895590.021796:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895590.021932:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073664 00000100:00100000:0.0:1790895590.021946:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073664 00000100:00100000:0.0:1790895590.022011:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 97 00000100:00100000:0.0:1790895590.022024:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+12:13862:x1877889741073664:12345-192.168.201.54@tcp:256:mount.lustre.0 20000000:01000000:0.0:1790895590.022058:0:14362:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1790895590.022090:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1790895590.022093:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1790895590.022097:0:14362:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1790895590.022099:0:14362:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1790895590.036056:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+12:13862:x1877889741073664:12345-192.168.201.54@tcp:256:mount.lustre.0 Request processed in 14023us (14260us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895590.036083:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 97 00000100:00100000:2.0:1790895590.040838:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895590.041021:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073792 00000100:00100000:0.0:1790895590.041034:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073792 00000100:00100000:0.0:1790895590.041097:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 98 00000100:00100000:0.0:1790895590.041108:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+12:13862:x1877889741073792:12345-192.168.201.54@tcp:101:mount.lustre.0 00010000:00010000:0.0:1790895590.041132:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895590.041157:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc3113 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895590.041191:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 13 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895590.041205:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 13 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895590.041216:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7cc00, rc 0) 00000100:00100000:0.0:1790895590.041291:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+13:13862:x1877889741073792:12345-192.168.201.54@tcp:101:mount.lustre.0 Request processed in 185us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895590.041298:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 98 00000100:00100000:3.0:1790895590.048200:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895590.048309:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741073920 00000100:00100000:0.0:1790895590.048321:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741073920 00000100:00100000:0.0:1790895590.048384:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 99 00000100:00100000:0.0:1790895590.048394:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+13:13862:x1877889741073920:12345-192.168.201.54@tcp:501:mount.lustre.0 00000100:00100000:0.0:1790895590.048702:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+13:13862:x1877889741073920:12345-192.168.201.54@tcp:501:mount.lustre.0 Request processed in 308us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895590.048710:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 99 00000100:00100000:1.0:1790895590.055661:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895590.055786:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074048 00000100:00100000:3.0:1790895590.055802:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074048 00000100:00100000:3.0:1790895590.055900:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 100 00000100:00100000:3.0:1790895590.055912:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+13:13862:x1877889741074048:12345-192.168.201.54@tcp:503:mount.lustre.0 00000100:00100000:3.0:1790895590.056277:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+13:13862:x1877889741074048:12345-192.168.201.54@tcp:503:mount.lustre.0 Request processed in 364us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895590.056286:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 100 00000100:00100000:3.0:1790895590.066236:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895590.066533:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074176 00000100:00100000:2.0:1790895590.066544:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074176 00000100:00100000:2.0:1790895590.066601:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 101 00000100:00100000:2.0:1790895590.066612:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+13:13875:x1877889741074176:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:2.0:1790895590.066949:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dabc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+13:13875:x1877889741074176:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 338us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895590.066957:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 101 00000100:00100000:2.0:1790895590.073345:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.073458:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074304 00000100:00100000:1.0:1790895590.073470:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074304 00000100:00100000:1.0:1790895590.073546:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 102 00000100:00100000:1.0:1790895590.073557:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+13:13875:x1877889741074304:12345-192.168.201.54@tcp:502:llog_process_th.0 00000100:00100000:1.0:1790895590.073806:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+13:13875:x1877889741074304:12345-192.168.201.54@tcp:502:llog_process_th.0 Request processed in 250us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895590.073814:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 102 00000100:00100000:1.0:1790895590.079522:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.079564:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.079598:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.079631:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.079670:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075072 00000100:00100000:1.0:1790895590.079679:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075072 00000100:00100000:1.0:1790895590.079728:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074944 00000100:00100000:1.0:1790895590.079731:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074944 00000100:00100000:1.0:1790895590.079749:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:1.0:1790895590.079757:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2364:x1877889741075072:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895590.079826:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2364:x1877889741075072:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 69us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895590.079833:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:1.0:1790895590.079849:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:1.0:1790895590.079855:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2364:x1877889741074944:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:1.0:1790895590.079911:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2364:x1877889741074944:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 56us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895590.079927:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:0.0:1790895590.080077:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074432 00000100:00100000:0.0:1790895590.080082:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074432 00000100:00100000:0.0:1790895590.080110:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074816 00000100:00100000:0.0:1790895590.080113:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074816 00000100:00100000:0.0:1790895590.080138:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1790895590.080146:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2364:x1877889741074816:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895590.080194:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2364:x1877889741074816:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 49us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895590.080201:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1790895590.080214:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:0.0:1790895590.080218:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2360:x1877889741074432:12345-192.168.201.54@tcp:38:mount.lustre.0 00010000:00080000:0.0:1790895590.080241:0:15620:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from eea0ff28-2c65-417b-9501-307d7aea62a8@192.168.201.54@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:0.0:1790895590.080272:0:15620:0:(genops.c:1384:class_connect()) connect: client eea0ff28-2c65-417b-9501-307d7aea62a8, cookie 0x7911a98710cf9ac2 00000004:00100000:0.0:1790895590.080300:0:15620:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1790895590.080410:0:15620:0:(import.c:65:import_set_state_nolock()) ffff8cf33fa42800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790895590.080436:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2360:x1877889741074432:12345-192.168.201.54@tcp:38:mount.lustre.0 Request processed in 216us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895590.080443:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:1.0:1790895590.093074:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.093128:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895590.093231:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074688 00000100:00100000:3.0:1790895590.093243:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074688 00000100:00100000:3.0:1790895590.093324:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741074560 00000100:00100000:3.0:1790895590.093328:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741074560 00000100:00100000:3.0:1790895590.093356:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1790895590.093366:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+7:13862:x1877889741074688:12345-192.168.201.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790895590.093409:0:14367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790895590.093473:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+7:13862:x1877889741074688:12345-192.168.201.54@tcp:41:mount.lustre.0 Request processed in 109us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895590.093481:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1790895590.093499:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1790895590.093506:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+6:0:x1877889741074560:12345-192.168.201.54@tcp:41:mount.lustre.0 00000004:00000024:3.0:1790895590.093517:0:14367:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1790895590.093560:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+6:0:x1877889741074560:12345-192.168.201.54@tcp:41:mount.lustre.0 Request processed in 54us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895590.093566:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00080000:1.0:1790895590.093641:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1790895590.099910:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895590.100017:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075200 00000100:00100000:0.0:1790895590.100027:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075200 00000100:00100000:0.0:1790895590.100084:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:0.0:1790895590.100092:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+6:13862:x1877889741075200:12345-192.168.201.54@tcp:40:mount.lustre.0 00000100:00100000:0.0:1790895590.100185:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+6:13862:x1877889741075200:12345-192.168.201.54@tcp:40:mount.lustre.0 Request processed in 93us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895590.100192:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:1.0:1790895590.104984:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.105034:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895590.105087:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895590.105178:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075328 00000100:00100000:2.0:1790895590.105190:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075328 00000100:00100000:2.0:1790895590.105236:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075456 00000100:00100000:2.0:1790895590.105240:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075456 00000100:00100000:2.0:1790895590.105257:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:2.0:1790895590.105266:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877889741075328:12345-192.168.201.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790895590.105306:0:15049:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from eea0ff28-2c65-417b-9501-307d7aea62a8@192.168.201.54@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1790895590.105341:0:15049:0:(genops.c:1384:class_connect()) connect: client eea0ff28-2c65-417b-9501-307d7aea62a8, cookie 0x7911a98710cf9ac9 00002000:00100000:2.0:1790895590.105354:0:15049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli eea0ff28-2c65-417b-9501-307d7aea62a8/ffff8cf2037b2800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790895590.105365:0:15049:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790895590.105490:0:15049:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1790895590.105528:0:15049:0:(import.c:65:import_set_state_nolock()) ffff8cf2037b4800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895590.105585:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2360:x1877889741075328:12345-192.168.201.54@tcp:8:mount.lustre.0 Request processed in 318us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895590.105593:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:2.0:1790895590.105610:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:2.0:1790895590.105615:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2360:x1877889741075456:12345-192.168.201.54@tcp:8:mount.lustre.0 00010000:00080000:2.0:1790895590.105630:0:15049:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from eea0ff28-2c65-417b-9501-307d7aea62a8@192.168.201.54@tcp t0 exp 0000000000000000 cur 463 last 0 00000020:00000080:2.0:1790895590.105648:0:15049:0:(genops.c:1384:class_connect()) connect: client eea0ff28-2c65-417b-9501-307d7aea62a8, cookie 0x7911a98710cf9ad0 00002000:00100000:2.0:1790895590.105653:0:15049:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli eea0ff28-2c65-417b-9501-307d7aea62a8/ffff8cf2037b5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a3f ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1790895590.105660:0:15049:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1790895590.105835:0:15049:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1790895590.105849:0:15049:0:(import.c:65:import_set_state_nolock()) ffff8cf2037b0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1790895590.105900:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2360:x1877889741075456:12345-192.168.201.54@tcp:8:mount.lustre.0 Request processed in 283us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895590.105907:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1790895590.106116:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075584 00000100:00100000:3.0:1790895590.106121:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075584 00000100:00100000:3.0:1790895590.106168:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:3.0:1790895590.106177:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+6:13862:x1877889741075584:12345-192.168.201.54@tcp:33:mount.lustre.0 00000004:00200000:3.0:1790895590.106250:0:14371:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1790895590.106301:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+6:13862:x1877889741075584:12345-192.168.201.54@tcp:33:mount.lustre.0 Request processed in 126us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895590.106308:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00010000:00010000:1.0:1790895590.168415:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790895590.286212:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895590.286386:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075712 00000100:00100000:2.0:1790895590.286397:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075712 00000100:00100000:2.0:1790895590.286511:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:2.0:1790895590.286521:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea0ff28-2c65-417b-9501-307d7aea62a8+6:13896:x1877889741075712:12345-192.168.201.54@tcp:101:mkdir.0 00010000:00010000:2.0:1790895590.286543:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895590.286566:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9ad7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc313d expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895590.286640:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895590.286670:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895590.286682:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895590.286716:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790895590.286720:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895590.286740:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895590.286767:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9ad7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 8 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895590.286787:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 7 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895590.286795:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:2.0:1790895590.286798:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895590.286802:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685200, rc 0) 00000100:00100000:2.0:1790895590.286909:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea0ff28-2c65-417b-9501-307d7aea62a8+7:13896:x1877889741075712:12345-192.168.201.54@tcp:101:mkdir.0 Request processed in 389us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895590.286926:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00010000:00010000:1.0:1790895591.194451:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1790895592.218644:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1790895592.351141:0:16324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:2.0:1790895592.459924:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a3a9f9f0-10b2-41f5-96b5-b7728332a4f3 00000001:00100000:2.0:1790895592.459940:0:6715:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of eea0ff28-2c65-417b-9501-307d7aea62a8 00000001:00100000:0.0:1790895593.000120:0:5854:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of eea0ff28-2c65-417b-9501-307d7aea62a8 00000001:00100000:0.0:1790895593.000137:0:5854:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a3a9f9f0-10b2-41f5-96b5-b7728332a4f3 00010000:00010000:0.0:1790895593.240963:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895593.433597:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895593.433623:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758889344:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895593.433701:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895593.433779:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889344 00000100:00100000:0.0:1790895593.433787:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889344 00000100:00100000:0.0:1790895593.433843:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790895593.433853:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758889344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895593.433918:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895593.433967:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758889344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895593.433974:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1790895593.433994:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1790895593.434030:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758889344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1790895594.269522:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895594.521850:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1790895594.968890:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758889472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895594.968971:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895594.968977:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3311:1877889758889600:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969009:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895594.969030:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758889984:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969032:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758890112:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969053:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895594.969073:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895594.969086:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758889728:0@lo:400:kworker.0 00000100:00100000:2.0:1790895594.969100:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758890112 00000100:00100000:2.0:1790895594.969107:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758890112 00000100:00100000:0.0:1790895594.969109:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895594.969125:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758890240:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969148:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895594.969154:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889984 00000100:00100000:2.0:1790895594.969157:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889984 00000100:00100000:0.0:1790895594.969163:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1790895594.969168:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758889856:0@lo:400:kworker.0 00000100:00100000:2.0:1790895594.969170:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758890240 00000100:00100000:2.0:1790895594.969172:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758890240 00000100:00100000:2.0:1790895594.969188:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790895594.969197:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758890112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969198:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895594.969233:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889472 00000100:00100000:0.0:1790895594.969236:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889472 00000100:00100000:2.0:1790895594.969250:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758890112:12345-0@lo:400:kworker.0 Request processed in 55us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895594.969257:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1790895594.969264:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790895594.969270:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758889472:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1790895594.969287:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790895594.969292:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758889984:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1790895594.969298:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1790895594.969322:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1877889758889984:12345-0@lo:400:kworker.0 Request processed in 30us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895594.969324:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1877889758889472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895594.969330:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1790895594.969349:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889600 00000100:00100000:0.0:1790895594.969352:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889600 00000100:00100000:0.0:1790895594.969376:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790895594.969382:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3311:x1877889758889600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969411:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dab050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3311:x1877889758889600:12345-0@lo:400:kworker.0 Request processed in 29us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895594.969416:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1790895594.969443:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790895594.969450:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969479:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1877889758890240:12345-0@lo:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895594.969485:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1790895594.969503:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889728 00000100:00100000:0.0:1790895594.969507:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889728 00000100:00100000:0.0:1790895594.969529:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758889856 00000100:00100000:0.0:1790895594.969531:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758889856 00000100:00100000:0.0:1790895594.969546:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790895594.969551:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758889728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969587:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758889728:12345-0@lo:400:kworker.0 Request processed in 36us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895594.969593:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790895594.969606:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790895594.969611:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758889856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969636:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758889856:12345-0@lo:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895594.969642:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1790895594.969657:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1790895594.969661:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1790895594.969691:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3311:1877889758889600:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969703:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758890112:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969736:0:3308:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1790895594.969746:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758889856:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969754:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758889728:0@lo:400:kworker.0 00000100:00100000:0.0:1790895594.969763:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3308:1877889758890240:0@lo:400:kworker.0 00000100:00100000:2.0:1790895594.970443:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1790895594.970484:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3310:1877889758889984:0@lo:400:kworker.0 00000100:00100000:2.0:1790895594.970501:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3310:1877889758889472:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1790895595.061599:0:7641:0:(tgt_lastrcvd.c:564:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of eea0ff28-2c65-417b-9501-307d7aea62a8 00000020:00000080:0.0:1790895595.110203:0:16477:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb601b1c0 20000000:00000080:0.0:1790895595.110220:0:16477:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8cf341556400 uarg=0000000000000000 20000000:01000000:0.0:1790895595.110256:0:16477:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790895595.110262:0:16477:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1790895595.110267:0:16477:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1790895595.111215:0:16478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1790895595.111405:0:16477:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1790895595.117100:0:16477:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1790895595.117244:0:16477:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117266:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117274:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9822 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117280:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9956 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117290:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117297:0:16477:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117305:0:16477:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117410:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117442:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 12 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.117459:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890368:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895595.117621:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 12 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117631:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 12 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.117640:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890496:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895595.117672:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf9956 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117680:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf9956 expref: 18 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.117690:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890624:0@lo:104: 00000100:00100000:1.0:1790895595.117731:0:16477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790895595.117776:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf9822 expref: 18 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117784:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf9822 expref: 18 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.117793:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890752:0@lo:104: 00000100:00100000:1.0:1790895595.117813:0:16477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1790895595.117888:0:16477:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 18 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895595.117897:0:16477:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 18 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.117906:0:16477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201183b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890880:0@lo:104: 00000100:00100000:1.0:1790895595.117931:0:16477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895595.117941:0:16477:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf308712540 going to sleep for 11 seconds 00000100:00100000:2.0:1790895595.118097:0:14351:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1790895595.118112:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758890624 00000100:00100000:2.0:1790895595.118119:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758890624 00000100:00100000:2.0:1790895595.118159:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758890752 00000100:00100000:2.0:1790895595.118169:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758890752 00000100:00100000:2.0:1790895595.118184:0:14351:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758890880 00000100:00100000:2.0:1790895595.118186:0:14351:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758890880 00000100:00100000:2.0:1790895595.118199:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790895595.118208:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+5:16477:x1877889758890624:12345-0@lo:104: 00010000:00010000:2.0:1790895595.118221:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118333:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1790895595.118339:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+5:16477:x1877889758890624:12345-0@lo:104: Request processed in 133us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895595.118345:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790895595.118361:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790895595.118366:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+4:16477:x1877889758890752:12345-0@lo:104: 00010000:00010000:2.0:1790895595.118373:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118402:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1790895595.118406:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+4:16477:x1877889758890752:12345-0@lo:104: Request processed in 41us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895595.118411:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1790895595.118420:0:14351:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1790895595.118426:0:14351:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf20128f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:16477:x1877889758890880:12345-0@lo:104: 00010000:00010000:2.0:1790895595.118432:0:14351:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118455:0:14351:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1790895595.118459:0:14351:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf20128f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+3:16477:x1877889758890880:12345-0@lo:104: Request processed in 34us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895595.118471:0:14351:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1790895595.118506:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1790895595.118512:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118520:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7de00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895595.118524:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118533:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895595.118541:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895595.118547:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790895595.118578:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118585:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895595.118604:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118610:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7de00/0x7911a98710cf9956 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf995d expref: -99 pid: 15765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118623:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1790895595.118626:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118641:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d600 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895595.118644:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118649:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895595.118655:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895595.118659:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790895595.118671:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118676:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895595.118689:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118695:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf31fe7d600/0x7911a98710cf9822 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf9829 expref: -99 pid: 15048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118703:0:14355:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790895595.118706:0:14355:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118710:0:14355:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91dc00 already unused, calling callback (ffffffffc1a76c20) 10000000:00010000:2.0:1790895595.118713:0:14355:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118727:0:14355:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790895595.118733:0:14355:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790895595.118737:0:14355:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1790895595.118748:0:14355:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118753:0:14355:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790895595.118758:0:14355:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118763:0:14355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.154@tcp lock: ffff8cf33f91dc00/0x7911a98710cf97d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7911a98710cf97dc expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895595.118775:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895595.118777:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790895595.118778:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895595.118790:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758891136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790895595.118818:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895595.118881:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1790895595.118887:0:3310:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758891264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1790895595.118909:0:3310:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1790895595.119063:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895595.119075:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758891008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895595.119108:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895595.119148:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891136 00000100:00100000:0.0:1790895595.119153:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891136 00010000:00010000:0.0:1790895595.119171:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf9822 expref: 19 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895595.119184:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891264 00000100:00100000:0.0:1790895595.119187:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891264 00010000:00010000:0.0:1790895595.119195:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 20 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895595.119202:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891008 00000100:00100000:0.0:1790895595.119204:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891008 00010000:00010000:0.0:1790895595.119212:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf9956 expref: 21 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895595.119222:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790895595.119227:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+21:3310:x1877889758891136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895595.119238:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895595.119242:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf9822 expref: 21 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.119250:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf9822 expref: 21 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.119264:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895595.119291:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+21:3310:x1877889758891136:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895595.119298:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790895595.119309:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790895595.119332:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+20:3310:x1877889758891264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895595.119339:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895595.119343:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 20 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.119349:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 20 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.119358:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895595.119380:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+20:3310:x1877889758891264:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895595.119386:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1790895595.119399:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790895595.119405:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf20118b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3309:x1877889758891008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1790895595.119412:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895595.119416:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7911a98710cf9956 expref: 19 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.119424:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7911a98710cf9956 expref: 19 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.119432:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895595.119456:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf20118b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3309:x1877889758891008:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895595.119462:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790895595.119515:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf34065b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3309:1877889758891008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895595.119538:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340659880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758891264:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1790895595.119545:0:3310:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf340658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3310:1877889758891136:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1790895595.121805:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167ca00/0x7911a98710cf995d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf9956 expref: 18 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.121821:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890624:0@lo:104: 00010000:00010000:1.0:1790895595.122199:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84fc00/0x7911a98710cf9829 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf9822 expref: 17 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.122209:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890752:0@lo:104: 00000100:00100000:3.0:1790895595.123272:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895595.123364:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00010000:00010000:1.0:1790895595.123439:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf33f84f400/0x7911a98710cf97dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7911a98710cf97d5 expref: 16 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895595.123452:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201183b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890880:0@lo:104: 00000100:00100000:1.0:1790895595.123468:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890368:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895595.123476:0:16477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16477:1877889758890496:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895595.123507:0:16477:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895595.123687:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075840 00000100:00100000:0.0:1790895595.123695:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075840 00010000:00010000:0.0:1790895595.123728:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 13 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895595.123766:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741075968 00000100:00100000:0.0:1790895595.123769:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741075968 00010000:00010000:0.0:1790895595.123781:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 14 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895595.123795:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:0.0:1790895595.123803:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68072c20-598b-412d-9027-10e9da026c3e+14:2361:x1877889741075840:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895595.123816:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895595.123821:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 14 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.123845:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 14 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.123892:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf31fe7cc00/0x7911a98710cf9abb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3113 expref: 14 pid: 14359 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.123905:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895595.123953:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68072c20-598b-412d-9027-10e9da026c3e+13:2361:x1877889741075840:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 150us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895595.123961:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:0.0:1790895595.123978:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1790895595.123984:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68072c20-598b-412d-9027-10e9da026c3e+12:2361:x1877889741075968:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895595.124007:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895595.124012:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 12 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124020:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 12 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124029:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf30167c400/0x7911a98710cf9a83 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc30b1 expref: 12 pid: 14361 timeout: 568 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124415:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124424:0:14354:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124438:0:14354:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124445:0:14354:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124451:0:14354:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124458:0:14354:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124463:0:14354:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895595.124467:0:14354:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124484:0:14354:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124500:0:14354:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895595.124510:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895595.124544:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:68072c20-598b-412d-9027-10e9da026c3e+11:2361:x1877889741075968:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 559us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895595.124550:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00010000:00010000:3.0:1790895595.124733:0:16477:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895595.124742:0:16477:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895595.124747:0:16477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8cf340a55200/0x7911a98710cf9ae5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16477 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895595.288222:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790895595.405371:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895595.405418:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895595.405449:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895595.405494:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895595.405516:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895595.405543:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895595.405576:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076352 00000100:00100000:3.0:1790895595.405586:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076352 00000100:00100000:3.0:1790895595.405636:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076608 00000100:00100000:3.0:1790895595.405638:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076608 00000100:00100000:3.0:1790895595.405649:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076224 00000100:00100000:3.0:1790895595.405651:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076224 00000100:00100000:3.0:1790895595.405663:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076736 00000100:00100000:3.0:1790895595.405665:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076736 00000100:00100000:3.0:1790895595.405680:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:3.0:1790895595.405689:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2363:x1877889741076352:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895595.405760:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2363:x1877889741076352:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 72us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895595.405768:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:3.0:1790895595.405785:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:3.0:1790895595.405791:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2363:x1877889741076608:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895595.405814:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2363:x1877889741076608:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895595.405819:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:3.0:1790895595.405841:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:3.0:1790895595.405847:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2363:x1877889741076224:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895595.405897:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2363:x1877889741076224:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 51us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895595.405903:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:3.0:1790895595.405929:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:3.0:1790895595.405935:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2363:x1877889741076736:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895595.405955:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2363:x1877889741076736:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 20us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895595.405960:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:3.0:1790895595.405974:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076096 00000100:00100000:3.0:1790895595.405977:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076096 00000100:00100000:3.0:1790895595.405999:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076480 00000100:00100000:3.0:1790895595.406002:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076480 00000100:00100000:3.0:1790895595.406016:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:3.0:1790895595.406022:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2363:x1877889741076096:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895595.406057:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2363:x1877889741076096:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 34us (697us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895595.406062:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:3.0:1790895595.406073:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:3.0:1790895595.406079:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2363:x1877889741076480:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895595.406098:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2363:x1877889741076480:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 20us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895595.406104:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00080000:3.0:1790895595.406117:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1790895595.406121:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1790895595.406123:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1790895596.312378:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1790895597.080065:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790895597.080075:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf310c5e800 from 10 10000000:01000000:1.0:1790895597.080101:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790895597.080153:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf340a55c00/0x7911a98710cf9aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.080166:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf340a55c00/0x7911a98710cf9aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.080178:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf340a55c00/0x7911a98710cf9aec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895597.080209:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.081230:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895597.081428:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895597.085088:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891392 00000100:00100000:2.0:1790895597.085104:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891392 00000100:00100000:2.0:1790895597.085184:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1790895597.085195:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+16:14364:x1877889758891392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895597.085227:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895597.085245:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf337684000/0x7911a98710cf9af3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9aec expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895597.085271:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf337684000/0x7911a98710cf9af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9aec expref: 17 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895597.085282:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf337684000/0x7911a98710cf9af3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9aec expref: 17 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895597.085301:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684000, rc 0) 00000100:00100000:2.0:1790895597.085374:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327daa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:14364:x1877889758891392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (4147us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895597.085380:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1790895597.085540:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895597.085557:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf340a55c00/0x7911a98710cf9aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9af3 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.085567:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf340a55c00/0x7911a98710cf9aec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9af3 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895597.085633:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.085664:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895597.085708:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895597.085848:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891520 00000100:00100000:3.0:1790895597.085853:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891520 00000100:00100000:3.0:1790895597.085906:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1790895597.085912:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758891520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895597.086129:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758891520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895597.086136:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1790895597.086419:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.086444:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.086478:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895597.086505:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895597.086605:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891648 00000100:00100000:3.0:1790895597.086609:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891648 00000100:00100000:3.0:1790895597.086636:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1790895597.086642:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:14364:x1877889758891648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895597.086783:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327dab450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:14364:x1877889758891648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895597.086789:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1790895597.087020:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1790895597.088281:0:16586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1790895597.093678:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1790895597.093720:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1790895597.093732:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf340a55c00/0x7911a98710cf9aec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9af3 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.093759:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf340a55c00/0x7911a98710cf9aec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9af3 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790895597.093773:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1790895597.093776:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf3393f8800 from 10 10000000:01000000:1.0:1790895597.093779:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790895597.093829:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf340a55800/0x7911a98710cf9afa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.093837:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf340a55800/0x7911a98710cf9afa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.093849:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf340a55800/0x7911a98710cf9afa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895597.093923:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.094001:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895597.094056:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1790895597.094238:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891776 00000100:00100000:3.0:1790895597.094247:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891776 00000100:00100000:3.0:1790895597.094304:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1790895597.094314:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+17:14364:x1877889758891776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895597.094327:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895597.094339:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf30167c600/0x7911a98710cf9b01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9afa expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895597.094364:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf30167c600/0x7911a98710cf9b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9afa expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895597.094375:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf30167c600/0x7911a98710cf9b01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9afa expref: 18 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895597.094382:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf30167c600, rc 0) 00000100:00100000:3.0:1790895597.094553:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758891776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895597.094578:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1790895597.095043:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895597.095062:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf340a55800/0x7911a98710cf9afa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9b01 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.095071:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf340a55800/0x7911a98710cf9afa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9b01 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895597.095140:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.095170:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895597.095210:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1790895597.095272:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758891904 00000100:00100000:2.0:1790895597.095280:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758891904 00000100:00100000:2.0:1790895597.095326:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1790895597.095335:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf327da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758891904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895597.096011:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf327da8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758891904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 675us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895597.096021:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1790895597.096217:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758891904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.096257:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.096371:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895597.096479:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758892032 00000100:00100000:0.0:1790895597.096487:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758892032 00000100:00100000:0.0:1790895597.096541:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1790895597.096550:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758892032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895597.102847:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758892032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5973us (6150us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895597.102956:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1790895597.103140:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31024ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1790895597.103176:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790895597.108241:0:16587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1790895597.113498:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1790895597.113602:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790895597.113615:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf340a55800/0x7911a98710cf9afa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9b01 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895597.113629:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf340a55800/0x7911a98710cf9afa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9b01 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790895597.113643:0:14364:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1790895597.113646:0:14364:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8cf336887800 from 10 10000000:01000000:3.0:1790895597.113649:0:14364:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1790895597.113693:0:14364:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf9b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895597.113701:0:14364:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf9b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895597.113712:0:14364:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf9b08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895597.114236:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1790895597.114620:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790895597.114723:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932600 going to sleep for 11 seconds 00000100:00100000:0.0:1790895597.118627:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758892160 00000100:00100000:0.0:1790895597.118643:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758892160 00000100:00100000:2.0:1790895597.118784:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1790895597.118796:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+18:14364:x1877889758892160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1790895597.118825:0:14362:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895597.118847:0:14362:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf337685e00/0x7911a98710cf9b0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7911a98710cf9b08 expref: -99 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895597.118903:0:14362:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf337685e00/0x7911a98710cf9b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7911a98710cf9b08 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895597.118933:0:14362:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf337685e00/0x7911a98710cf9b0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7911a98710cf9b08 expref: 19 pid: 14362 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895597.118945:0:14362:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685e00, rc 0) 00000100:00100000:2.0:1790895597.119027:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758892160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (4408us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895597.119047:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1790895597.119189:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1790895597.119208:0:14364:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf9b08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9b0f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895597.119218:0:14364:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf9b08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7911a98710cf9b0f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895597.119297:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895597.119332:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895597.119374:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758892288 00000100:00100000:1.0:1790895597.119379:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758892288 00000100:00100000:3.0:1790895597.119381:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932600 going to sleep for 11 seconds 00000100:00100000:1.0:1790895597.119427:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1790895597.119436:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758892288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.119702:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758892288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895597.119709:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1790895597.120554:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336e34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1790895597.120603:0:14364:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1790895597.120656:0:14364:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895597.120693:0:14364:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31861bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1790895597.120725:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758892416 00000100:00100000:1.0:1790895597.120732:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758892416 00000100:00100000:1.0:1790895597.120781:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1790895597.120789:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758892416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.121336:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:14364:x1877889758892416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 547us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895597.121344:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1790895597.121365:0:14364:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:38adfb21-dafb-4eb3-8476-02ed33ee7efa:14364:1877889758892416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1790895597.122428:0:16588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1790895597.122680:0:14364:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1790895597.122700:0:14364:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.154@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1790895597.122710:0:14364:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf9b08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9b0f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895597.122722:0:14364:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.154@tcp lock: ffff8cf30167de00/0x7911a98710cf9b08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7911a98710cf9b0f expref: -99 pid: 14364 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895597.131911:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895597.132030:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076864 00000100:00100000:0.0:1790895597.132043:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076864 00000100:00100000:0.0:1790895597.132106:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:0.0:1790895597.132116:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3061b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+11:13750:x1877889741076864:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1790895597.132134:0:14359:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895597.132154:0:14359:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf31fe7d800/0x7911a98710cf9b16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc3144 expref: -99 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895597.132206:0:14359:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf31fe7d800/0x7911a98710cf9b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3144 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895597.132219:0:14359:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf31fe7d800/0x7911a98710cf9b16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3144 expref: 12 pid: 14359 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895597.132228:0:14359:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7d800, rc 0) 00000100:00100000:0.0:1790895597.132301:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3061b2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+12:13750:x1877889741076864:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 177us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895597.132308:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 113 00000100:00100000:3.0:1790895597.134829:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895597.134925:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741076992 00000100:00100000:1.0:1790895597.134936:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741076992 00000100:00100000:1.0:1790895597.134985:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:1.0:1790895597.134998:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+12:13750:x1877889741076992:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1790895597.135331:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+12:13750:x1877889741076992:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 335us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895597.135339:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 114 00000100:00100000:2.0:1790895597.140088:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895597.140154:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741077120 00000100:00100000:3.0:1790895597.140166:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741077120 00000100:00100000:3.0:1790895597.140223:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:3.0:1790895597.140235:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+12:13750:x1877889741077120:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1790895597.140494:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+12:13750:x1877889741077120:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 259us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895597.140502:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 115 00000100:00100000:2.0:1790895597.145616:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895597.145809:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741077248 00000100:00100000:1.0:1790895597.145821:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741077248 00000100:00100000:1.0:1790895597.145917:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:1.0:1790895597.145930:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+12:13750:x1877889741077248:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1790895597.145951:0:14361:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895597.145973:0:14361:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8cf340a54000/0x7911a98710cf9b1d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8300040986fc314b expref: -99 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.146004:0:14361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8cf340a54000/0x7911a98710cf9b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc314b expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.146017:0:14361:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8cf340a54000/0x7911a98710cf9b1d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc314b expref: 13 pid: 14361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895597.146027:0:14361:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a54000, rc 0) 00000100:00100000:1.0:1790895597.146111:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:68072c20-598b-412d-9027-10e9da026c3e+13:13750:x1877889741077248:12345-192.168.201.54@tcp:101:ll_cfg_requeue.0 Request processed in 184us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895597.146118:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 116 00000100:00100000:1.0:1790895597.150945:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895597.151054:0:14362:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741077376 00000100:00100000:3.0:1790895597.151066:0:14362:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741077376 00000100:00100000:3.0:1790895597.151121:0:14362:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:3.0:1790895597.151131:0:14362:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+13:13750:x1877889741077376:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1790895597.151404:0:14362:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:68072c20-598b-412d-9027-10e9da026c3e+13:13750:x1877889741077376:12345-192.168.201.54@tcp:501:ll_cfg_requeue.0 Request processed in 273us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895597.151412:0:14362:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 117 00000100:00100000:2.0:1790895597.153079:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895597.153143:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741077504 00000100:00100000:0.0:1790895597.153154:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741077504 00000100:00100000:0.0:1790895597.153203:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 118 00000100:00100000:0.0:1790895597.153214:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+13:13750:x1877889741077504:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1790895597.153442:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+13:13750:x1877889741077504:12345-192.168.201.54@tcp:503:ll_cfg_requeue.0 Request processed in 229us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895597.153451:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 118 00010000:00010000:3.0:1790895597.337958:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790895598.000594:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.000699:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741077632 00000100:00100000:3.0:1790895598.000710:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741077632 00000100:00100000:3.0:1790895598.000808:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:3.0:1790895598.000820:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:14405:x1877889741077632:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895598.000843:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895598.000911:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9b24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3152 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.000987:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001002:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001014:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001042:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001051:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001058:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001593:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9b39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001604:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001611:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895598.001637:0:15620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790895598.001641:0:15620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895598.001677:0:15620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9b39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001693:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001700:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001707:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001713:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf30167ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.001717:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001724:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001737:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895598.001740:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.001745:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001752:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167ca00/0x7911a98710cf9b2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001765:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001771:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001777:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001803:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91dc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.001806:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001812:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001821:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8cf3183e2400) 00010000:00010000:3.0:1790895598.001823:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.001826:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.001833:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1790895598.002377:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790895598.003326:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167c400/0x7911a98710cf9b24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3152 expref: 8 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.003352:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d800/0x7911a98710cf9b39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3152 expref: 7 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.003361:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf3183e2d00) 00010000:00010000:3.0:1790895598.003364:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895598.003367:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d800, rc 0) 00000100:00100000:3.0:1790895598.003451:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:14405:x1877889741077632:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 2632us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.003460:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:1.0:1790895598.007900:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.008053:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741077888 00000100:00100000:3.0:1790895598.008082:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741077888 00000100:00100000:3.0:1790895598.008148:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:3.0:1790895598.008160:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:14405:x1877889741077888:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1790895598.008191:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895598.008219:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3159 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.008315:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.008330:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.008342:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.008406:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.008414:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.008422:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.009607:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9b55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.009623:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9b55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.009631:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9b55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895598.009649:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1790895598.010512:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010524:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010532:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010538:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.010544:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010553:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010594:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8cf3183e2d00) 00010000:00010000:3.0:1790895598.010598:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.010604:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010610:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9b47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010624:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010631:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010651:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010656:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.010659:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010666:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010675:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8cf3183e2400) 00010000:00010000:3.0:1790895598.010678:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.010682:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.010688:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.011757:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3159 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.011776:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d000/0x7911a98710cf9b55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3159 expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.011796:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf3183e2600) 00010000:00010000:3.0:1790895598.011799:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.011802:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d000, rc 0) 00000100:00100000:3.0:1790895598.012073:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14405:x1877889741077888:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 3914us (4216us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1790895598.012091:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:3.0:1790895598.017425:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.017519:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741078016 00000100:00100000:1.0:1790895598.017529:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741078016 00000100:00100000:1.0:1790895598.017589:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:1.0:1790895598.017600:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf336e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14405:x1877889741078016:12345-192.168.201.54@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1790895598.017707:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf336e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14405:x1877889741078016:12345-192.168.201.54@tcp:59:lhsmtool_posix.0 Request processed in 109us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895598.017715:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:2.0:1790895598.094432:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.094579:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741078144 00000100:00100000:1.0:1790895598.094590:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741078144 00000100:00100000:1.0:1790895598.094648:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:1.0:1790895598.094658:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14411:x1877889741078144:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895598.094677:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895598.094699:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3160 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.094760:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.094775:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.094800:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.094814:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.094821:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.094837:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095006:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095015:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095021:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095027:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55a00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895598.095457:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095467:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095482:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:1.0:1790895598.095485:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895598.095490:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095496:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9b6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095508:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095514:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095528:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095533:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895598.095536:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095547:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095556:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf318c52100) 00010000:00010000:1.0:1790895598.095558:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895598.095560:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095565:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9b71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095598:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3160 expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095607:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:1.0:1790895598.095609:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895598.095612:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3160 expref: 10 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.095620:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a54c00, rc 0) 00000100:00100000:1.0:1790895598.095674:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14411:x1877889741078144:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 1018us (1250us total) trans 0 rc 301/301 00000100:00100000:1.0:1790895598.095689:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:1.0:1790895598.123812:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.123926:0:14376:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741078272 00000100:00100000:3.0:1790895598.123938:0:14376:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741078272 00000100:00100000:3.0:1790895598.123992:0:14376:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:3.0:1790895598.124003:0:14376:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14411:x1877889741078272:12345-192.168.201.54@tcp:700:lfs.0 00000100:00100000:3.0:1790895598.124101:0:14376:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14411:x1877889741078272:12345-192.168.201.54@tcp:700:lfs.0 Request processed in 100us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.124109:0:14376:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:3.0:1790895598.131708:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.131814:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741078528 00000100:00100000:2.0:1790895598.131825:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741078528 00000100:00100000:2.0:1790895598.131907:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 19 00000100:00100000:2.0:1790895598.131920:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14411:x1877889741078528:12345-192.168.201.54@tcp:36:lfs.0 00010000:00010000:2.0:1790895598.131978:0:14369:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895598.132005:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf30167da00/0x7911a98710cf9aa6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc30db expref: 9 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.132025:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:2.0:1790895598.132029:0:14369:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895598.132437:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.132452:0:14369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 5 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.132460:0:14369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.132495:0:14369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 5 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.132509:0:14369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 5 pid: 14369 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895598.132523:0:14369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14369:1877889758892544:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895598.132622:0:14369:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306499900 going to sleep for 11 seconds 00000001:00080000:0.0:1790895598.134334:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000100:00100000:2.0:1790895598.141532:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.141751:0:14369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf310112a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14369:1877889758892544:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895598.141779:0:14369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.141835:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741078656 00000100:00100000:3.0:1790895598.141849:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741078656 00000100:00080000:0.0:1790895598.141984:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1790895598.141993:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 6 pid: 14369 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.142107:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:3.0:1790895598.142116:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2362:x1877889741078656:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895598.142131:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895598.142137:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 6 pid: 14369 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.142150:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 6 pid: 14369 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.142179:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9ade lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc313d expref: 6 pid: 14369 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.142215:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:3.0:1790895598.142220:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.142238:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.142245:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.142320:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895598.142384:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2362:x1877889741078656:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 267us (861us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.142391:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00010000:00010000:1.0:1790895598.144363:0:14369:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.144436:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.144466:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.144478:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.144488:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895598.150356:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790895598.150455:0:14369:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.150471:0:14369:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.150479:0:14369:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.150512:0:14369:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685a00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895598.150517:0:14369:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.150531:0:14369:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.150551:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf3183e2900) 00010000:00010000:1.0:1790895598.150555:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895598.150565:0:14369:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.150573:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685a00/0x7911a98710cf9b78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895598.150603:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0c566e3 reply state 00000000b8543bfd transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.150612:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895598.150811:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14411:x1877889741078528:12345-192.168.201.54@tcp:36:lfs.0 Request processed in 18887us (19104us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1790895598.150821:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 19 00010000:00010000:0.0:1790895598.171634:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.171658:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.171667:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.171695:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54c00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895598.171700:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.171714:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.171741:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf318c52100) 00010000:00010000:0.0:1790895598.171744:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895598.171750:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.171757:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54c00/0x7911a98710cf9b7f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.312736:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.312897:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741078784 00000100:00100000:2.0:1790895598.312912:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741078784 00000100:00100000:2.0:1790895598.312976:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:2.0:1790895598.312987:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+8:14419:x1877889741078784:12345-192.168.201.54@tcp:101:lctl.0 00010000:00010000:2.0:1790895598.313012:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895598.313037:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9b86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3167 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.313106:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684400/0x7911a98710cf9b8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.313122:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684400/0x7911a98710cf9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.313135:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684400/0x7911a98710cf9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895598.313180:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790895598.313184:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895598.313221:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684400/0x7911a98710cf9b8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.313253:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9b86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3167 expref: 10 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.313310:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684400/0x7911a98710cf9b8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3167 expref: 9 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.313319:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:2.0:1790895598.313335:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895598.313339:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684400, rc 0) 00000100:00100000:2.0:1790895598.313428:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14419:x1877889741078784:12345-192.168.201.54@tcp:101:lctl.0 Request processed in 442us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895598.313442:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 20 00000100:00100000:2.0:1790895598.339506:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.339631:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741078912 00000100:00100000:3.0:1790895598.339642:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741078912 00000100:00100000:3.0:1790895598.339707:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:3.0:1790895598.339717:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+5:14420:x1877889741078912:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895598.339736:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895598.339756:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc316e expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.339844:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b9b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.339902:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.339933:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895598.339970:0:15620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790895598.339975:0:15620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895598.339997:0:15620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b9b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.340032:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9b94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc316e expref: 7 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.340050:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c800/0x7911a98710cf9b9b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc316e expref: 6 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.340058:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:3.0:1790895598.340061:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1790895598.340064:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91c800, rc 0) 00000100:00100000:3.0:1790895598.340129:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310112a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+6:14420:x1877889741078912:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 414us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.340136:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 21 00000100:00100000:3.0:1790895598.342713:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.342802:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741079040 00000100:00100000:2.0:1790895598.342811:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741079040 00000100:00100000:2.0:1790895598.342881:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:2.0:1790895598.342890:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+6:14420:x1877889741079040:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895598.342908:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895598.342926:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9ba2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3175 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.342985:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.342998:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343009:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343022:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343029:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343035:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343154:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9bb7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343162:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343169:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895598.343195:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790895598.343199:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895598.343215:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343226:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343233:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343240:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343246:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337684800 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895598.343250:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343258:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343268:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:2.0:1790895598.343489:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895598.343495:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343502:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9ba9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343517:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343522:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343528:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343533:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895598.343536:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343541:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343548:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf33290b500) 00010000:00010000:2.0:1790895598.343550:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1790895598.343553:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343558:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343583:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9ba2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3175 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343606:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3175 expref: 7 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.343613:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf33290b300) 00010000:00010000:2.0:1790895598.343616:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895598.343618:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685c00, rc 0) 00000100:00100000:2.0:1790895598.343732:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+7:14420:x1877889741079040:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 842us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895598.343739:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 22 00000100:00100000:0.0:1790895598.348532:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.348616:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741079296 00000100:00100000:1.0:1790895598.348626:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741079296 00000100:00100000:1.0:1790895598.348818:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:1.0:1790895598.348839:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea0ff28-2c65-417b-9501-307d7aea62a8+7:14420:x1877889741079296:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:1.0:1790895598.348878:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895598.348906:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9bbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc317c expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895598.349016:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1790895598.349141:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9bbe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc317c expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.349152:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:1.0:1790895598.349154:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1790895598.349158:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9bbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc317c expref: 9 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.349168:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a55400, rc 0) 00000100:00100000:1.0:1790895598.349218:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:eea0ff28-2c65-417b-9501-307d7aea62a8+8:14420:x1877889741079296:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 382us (694us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1790895598.349225:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 23 00000100:00100000:0.0:1790895598.351321:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.351360:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741079552 00000100:00100000:1.0:1790895598.351368:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741079552 00000100:00100000:1.0:1790895598.351419:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:1.0:1790895598.351429:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+8:14420:x1877889741079552:12345-192.168.201.54@tcp:36:lfs.0 00010000:00010000:1.0:1790895598.351564:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895598.351585:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9bb7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3175 expref: 8 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.351607:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf33290b300) 00010000:00010000:1.0:1790895598.351615:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1790895598.351633:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.351656:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.351663:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895598.352030:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a2b9e982 reply state 0000000096b647d0 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.352037:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1790895598.352043:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1790895598.352105:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+9:14420:x1877889741079552:12345-192.168.201.54@tcp:36:lfs.0 Request processed in 677us (788us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790895598.352112:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 24 00000100:00100000:2.0:1790895598.355343:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00010000:00010000:0.0:1790895598.355487:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.355503:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.355511:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.355518:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55a00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895598.355523:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.355551:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.355567:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf318c52400) 00010000:00010000:0.0:1790895598.355570:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1790895598.355576:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.355583:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55a00/0x7911a98710cf9bcc lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.355929:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741079808 00000100:00100000:3.0:1790895598.355940:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741079808 00000100:00100000:0.0:1790895598.356541:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:3.0:1790895598.356549:0:14371:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1790895598.356551:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+8:14420:x1877889741079808:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:3.0:1790895598.356558:0:14371:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:0.0:1790895598.356789:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf310111500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+9:14420:x1877889741079808:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 238us (1459us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1790895598.356797:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:2.0:1790895598.359046:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.359120:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741080064 00000100:00100000:3.0:1790895598.359130:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741080064 00000100:00100000:3.0:1790895598.359185:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:3.0:1790895598.359195:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+9:14420:x1877889741080064:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:3.0:1790895598.359232:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895598.359251:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9bd3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3183 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359319:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359330:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359338:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359348:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359352:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359356:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895598.359439:0:15620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1790895598.359526:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359533:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359540:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359554:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.359559:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359567:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359579:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:3.0:1790895598.359581:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.359585:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359589:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9bda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359597:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359602:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359607:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359612:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.359614:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359620:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359637:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf3183e2400) 00010000:00010000:3.0:1790895598.359640:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.359643:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359649:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9be1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359679:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9bd3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3183 expref: 11 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359686:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:3.0:1790895598.359687:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895598.359690:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9bd3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3183 expref: 11 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.359695:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91dc00, rc 0) 00000100:00100000:3.0:1790895598.359746:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+10:14420:x1877889741080064:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 553us (711us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1790895598.359751:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 25 00010000:00010000:1.0:1790895598.361293:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895598.362677:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.362760:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741080192 00000100:00100000:2.0:1790895598.362770:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741080192 00000100:00100000:2.0:1790895598.362950:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:2.0:1790895598.362959:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+10:14420:x1877889741080192:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895598.362977:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895598.362993:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bef lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc318a expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.363082:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.363091:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.363099:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895598.363123:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1790895598.363126:0:14368:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1790895598.363139:0:14368:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.363158:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9bef lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 12 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.363171:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.363177:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf33290b500) 00010000:00010000:2.0:1790895598.363179:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1790895598.363181:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684800, rc 0) 00000100:00100000:2.0:1790895598.363219:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+11:14420:x1877889741080192:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 263us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895598.363223:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 26 00000100:00100000:0.0:1790895598.365610:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.365657:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741080320 00000100:00100000:1.0:1790895598.365667:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741080320 00000100:00100000:1.0:1790895598.365721:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:1.0:1790895598.365731:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+11:14420:x1877889741080320:12345-192.168.201.54@tcp:37:lfs.0 00000100:00100000:1.0:1790895598.369348:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+11:14420:x1877889741080320:12345-192.168.201.54@tcp:37:lfs.0 Request processed in 3610us (3746us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895598.369357:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:0.0:1790895598.371917:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.371980:0:16589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741080576 00000100:00100000:2.0:1790895598.371989:0:16589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741080576 00000100:00100000:2.0:1790895598.372136:0:16589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:2.0:1790895598.372146:0:16589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf337cec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eea0ff28-2c65-417b-9501-307d7aea62a8+11:14420:x1877889741080576:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:2.0:1790895598.372342:0:16589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf337cec450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:eea0ff28-2c65-417b-9501-307d7aea62a8+12:14420:x1877889741080576:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 198us (488us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790895598.372347:0:16589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:0.0:1790895598.418226:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.418390:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741080704 00000100:00100000:3.0:1790895598.418400:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741080704 00000100:00100000:3.0:1790895598.418461:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:3.0:1790895598.418472:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:14426:x1877889741080704:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895598.418493:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895598.418513:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9bfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3191 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418602:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418616:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418627:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418641:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418647:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418653:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418742:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91de00/0x7911a98710cf9c12 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418750:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91de00/0x7911a98710cf9c12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418757:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91de00/0x7911a98710cf9c12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895598.418795:0:15620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1790895598.418799:0:15620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895598.418841:0:15620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91de00/0x7911a98710cf9c12 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418904:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418912:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418919:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418926:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.418930:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418939:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418952:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:3.0:1790895598.418956:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.418960:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418966:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418979:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418985:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.418990:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.419001:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91d400 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.419004:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.419010:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.419080:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8cf3183e2400) 00010000:00010000:3.0:1790895598.419083:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895598.419086:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.419092:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.419123:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9bfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3191 expref: 11 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.419137:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91de00/0x7911a98710cf9c12 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3191 expref: 10 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.419144:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf33290b500) 00010000:00010000:3.0:1790895598.419146:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1790895598.419149:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91de00, rc 0) 00000100:00100000:3.0:1790895598.419203:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+10:14426:x1877889741080704:12345-192.168.201.54@tcp:101:bash.0 Request processed in 732us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.419210:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 27 00000100:00100000:3.0:1790895598.422558:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.422663:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741080960 00000100:00100000:1.0:1790895598.422673:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741080960 00000100:00100000:1.0:1790895598.422742:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:1.0:1790895598.422752:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+10:14426:x1877889741080960:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:1.0:1790895598.422773:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895598.422809:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9c19 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc3198 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.422968:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.422984:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.422993:0:14367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.423037:0:14367:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 11 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.423050:0:14367:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 11 pid: 14368 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.423063:0:14367:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201183b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14367:1877889758892672:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895598.423146:0:14367:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3060efe40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895598.426492:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895598.426797:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741081088 00000100:00100000:0.0:1790895598.426807:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741081088 00010000:00010000:0.0:1790895598.426847:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 12 pid: 14368 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895598.426918:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:0.0:1790895598.426928:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+12:2361:x1877889741081088:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895598.426959:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895598.426967:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 12 pid: 14368 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.426980:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 12 pid: 14368 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.427001:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf33290b500) 00010000:00010000:0.0:1790895598.427006:0:14353:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.427026:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.427035:0:14353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.427053:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895598.427100:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+12:2361:x1877889741081088:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 174us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895598.427107:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00010000:00010000:1.0:1790895598.427744:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9bf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc318a expref: 11 pid: 14368 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.427763:0:14367:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201183b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14367:1877889758892672:192.168.201.54@tcp:104: 00010000:00010000:1.0:1790895598.427794:0:14367:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.427802:0:14367:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.427818:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.427840:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.427851:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.428145:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.428812:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.428823:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.428831:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895598.428841:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1790895598.429194:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429204:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429211:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429217:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895598.429228:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429236:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429247:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf33290b500) 00010000:00010000:1.0:1790895598.429251:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895598.429255:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429350:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c20 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1790895598.429365:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b96d34df reply state 0000000054b970ad transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.429374:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1790895598.429413:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55400/0x7911a98710cf9c19 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 13 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429428:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 12 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.429436:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:1.0:1790895598.429439:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1790895598.429441:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a55e00, rc 0) 00000100:00100000:1.0:1790895598.429550:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+13:14426:x1877889741080960:12345-192.168.201.54@tcp:101:bash.0 Request processed in 6799us (7001us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790895598.429559:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 28 00000100:00100000:2.0:1790895598.440943:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.441332:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741081216 00000100:00100000:3.0:1790895598.441346:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741081216 00000100:00100000:3.0:1790895598.441405:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 29 00000100:00100000:3.0:1790895598.441415:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+13:14426:x1877889741081216:12345-192.168.201.54@tcp:101:bash.0 00010000:00010000:3.0:1790895598.441440:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895598.441461:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c3c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc319f expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.441530:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.441545:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.441556:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1790895598.441599:0:15620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1790895598.441604:0:15620:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1790895598.441623:0:15620:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.441634:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.441659:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c3c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 15 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.441677:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 14 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.442112:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:3.0:1790895598.442115:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1790895598.442118:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91d400, rc 0) 00000100:00100000:2.0:1790895598.442223:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+14:14426:x1877889741081216:12345-192.168.201.54@tcp:101:bash.0 Request processed in 808us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895598.442235:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 29 00010000:00010000:1.0:1790895598.443130:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.443142:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.443150:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.443155:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895598.443160:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.443167:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.443181:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8cf318c52c00) 00010000:00010000:1.0:1790895598.443184:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895598.443188:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.443195:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55000/0x7911a98710cf9c27 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895598.445432:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.445507:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741081472 00000100:00100000:1.0:1790895598.445518:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741081472 00000100:00100000:1.0:1790895598.445577:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:1.0:1790895598.445588:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+13:14426:x1877889741081472:12345-192.168.201.54@tcp:35:bash.0 00000100:00100000:1.0:1790895598.446004:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+14:14426:x1877889741081472:12345-192.168.201.54@tcp:35:bash.0 Request processed in 417us (579us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1790895598.446012:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1790895598.524036:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.524175:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741081728 00000100:00100000:2.0:1790895598.524186:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741081728 00000100:00100000:2.0:1790895598.524249:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:2.0:1790895598.524259:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+14:14436:x1877889741081728:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895598.524294:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895598.524315:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9c4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31a6 expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895598.524406:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1790895598.524532:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9c4a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31a6 expref: 16 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.524547:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8cf33290b400) 00010000:00010000:2.0:1790895598.524551:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790895598.524558:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9c4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31a6 expref: 16 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.524574:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684c00, rc 0) 00000100:00100000:2.0:1790895598.524637:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+15:14436:x1877889741081728:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 379us (621us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1790895598.524645:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 30 00000100:00100000:2.0:1790895598.526690:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895598.526760:0:16589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741081984 00000100:00100000:0.0:1790895598.526770:0:16589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741081984 00000100:00100000:0.0:1790895598.526830:0:16589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:0.0:1790895598.526840:0:16589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+15:14436:x1877889741081984:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:0.0:1790895598.527095:0:16589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+16:14436:x1877889741081984:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 257us (409us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1790895598.527116:0:16589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:1.0:1790895598.552217:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790895598.552240:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3369e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758892800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1790895598.552312:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895598.552456:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758892800 00000100:00100000:0.0:1790895598.552464:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758892800 00000100:00100000:0.0:1790895598.552530:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790895598.552540:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758892800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1790895598.552574:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895598.552614:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758892800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895598.552621:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1790895598.552682:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895598.552834:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3369e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758892800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1790895598.556622:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.556733:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741082240 00000100:00100000:2.0:1790895598.556744:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741082240 00000100:00100000:2.0:1790895598.556816:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:2.0:1790895598.556828:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+16:14439:x1877889741082240:12345-192.168.201.54@tcp:101:lfs.0 00010000:00010000:2.0:1790895598.556908:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895598.556928:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9c58 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31ad expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.557036:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9c5f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.557050:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9c5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.557061:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9c5f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895598.557073:0:14369:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790895598.557194:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9c58 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31ad expref: 19 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.557213:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9c5f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31ad expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.557223:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:2.0:1790895598.557226:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895598.557230:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684800, rc 0) 00000100:00100000:2.0:1790895598.557474:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:14439:x1877889741082240:12345-192.168.201.54@tcp:101:lfs.0 Request processed in 648us (862us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1790895598.557481:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 31 00000100:00100000:2.0:1790895598.561766:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.561841:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895598.562126:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741082496 00000100:00100000:0.0:1790895598.562138:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741082496 00000100:00100000:0.0:1790895598.562244:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:0.0:1790895598.562257:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:2363:x1877889741082496:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895598.562284:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895598.562309:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684800/0x7911a98710cf9c5f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31ad expref: 18 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.562330:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:0.0:1790895598.562336:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895598.562388:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+17:2363:x1877889741082496:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 134us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895598.562396:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:3.0:1790895598.562604:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741082368 00000100:00100000:3.0:1790895598.562610:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741082368 00000100:00100000:3.0:1790895598.562652:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:3.0:1790895598.562661:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+17:14439:x1877889741082368:12345-192.168.201.54@tcp:54:lfs.0 00010000:00010000:3.0:1790895598.562732:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562749:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562761:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562793:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562800:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562806:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562812:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91dc00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895598.562816:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562839:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562848:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:3.0:1790895598.562852:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1790895598.562878:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.562885:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c6d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.562922:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+17:14439:x1877889741082368:12345-192.168.201.54@tcp:54:lfs.0 Request processed in 263us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.562928:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 32 00000100:00100000:1.0:1790895598.565563:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.565645:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741082752 00000100:00100000:3.0:1790895598.565655:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741082752 00000100:00100000:3.0:1790895598.565714:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:3.0:1790895598.565725:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+17:14439:x1877889741082752:12345-192.168.201.54@tcp:35:lfs.0 00000100:00100000:3.0:1790895598.566095:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:14439:x1877889741082752:12345-192.168.201.54@tcp:35:lfs.0 Request processed in 371us (540us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1790895598.566103:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000040:00080000:2.0:1790895598.616487:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1790895598.789396:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.789463:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741083008 00000100:00100000:2.0:1790895598.789472:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741083008 00000100:00100000:2.0:1790895598.789605:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:2.0:1790895598.789617:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:14470:x1877889741083008:12345-192.168.201.54@tcp:101:cat.0 00010000:00010000:2.0:1790895598.789651:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895598.789670:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9c74 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31b4 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.789807:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9c7b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.789837:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.789851:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9c7b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895598.789889:0:15620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790895598.790281:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9c74 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31b4 expref: 21 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.790296:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9c7b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31b4 expref: 20 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.790302:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:2.0:1790895598.790305:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1790895598.790309:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685400, rc 0) 00000100:00100000:2.0:1790895598.790372:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:14470:x1877889741083008:12345-192.168.201.54@tcp:101:cat.0 Request processed in 758us (982us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1790895598.790396:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 33 00000100:00100000:3.0:1790895598.793054:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.793113:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741083264 00000100:00100000:1.0:1790895598.793122:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741083264 00000100:00100000:1.0:1790895598.793177:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:1.0:1790895598.793187:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:14470:x1877889741083264:12345-192.168.201.54@tcp:35:cat.0 00000100:00100000:1.0:1790895598.797261:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+21:14470:x1877889741083264:12345-192.168.201.54@tcp:35:cat.0 Request processed in 4065us (4203us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1790895598.797276:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 8 00000100:00100000:0.0:1790895598.800259:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.800345:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741083392 00000100:00100000:3.0:1790895598.800356:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741083392 00000100:00100000:3.0:1790895598.800434:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:3.0:1790895598.800444:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+21:2364:x1877889741083392:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895598.800460:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895598.800499:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685400/0x7911a98710cf9c7b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31b4 expref: 21 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.800521:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:3.0:1790895598.800527:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1790895598.800588:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:2364:x1877889741083392:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 146us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.800595:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:0.0:1790895598.881651:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895598.881848:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741083648 00000100:00100000:3.0:1790895598.881892:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741083648 00000100:00100000:3.0:1790895598.881953:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:3.0:1790895598.881964:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:14476:x1877889741083648:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:3.0:1790895598.881990:0:14368:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790895598.882010:0:14368:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c89 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31bb expref: -99 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.882110:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.882124:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 21 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.882131:0:14368:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 21 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.882139:0:14368:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.882173:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 21 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.882195:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 21 pid: 15620 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.882207:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf307683b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14368:1877889758892928:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895598.882301:0:14368:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 21 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.882310:0:14368:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 21 pid: 14367 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.882318:0:14368:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf307682a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14368:1877889758893056:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895598.882341:0:14368:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf306498e40 going to sleep for 11 seconds 00000100:00100000:3.0:1790895598.891124:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf307683b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14368:1877889758892928:192.168.201.54@tcp:104: 00000100:00100000:3.0:1790895598.891140:0:14368:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf307682a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14368:1877889758893056:192.168.201.54@tcp:104: 00010000:00010000:3.0:1790895598.891164:0:14368:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895598.893058:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895598.893107:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.893136:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741083776 00000100:00100000:2.0:1790895598.893147:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741083776 00000100:00100000:3.0:1790895598.893198:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741083904 00010000:00010000:2.0:1790895598.893201:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 22 pid: 15620 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.893204:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741083904 00010000:00010000:3.0:1790895598.893227:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 23 pid: 14367 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895598.893253:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:2.0:1790895598.893265:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201189c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:2362:x1877889741083776:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1790895598.893282:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1790895598.893292:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 23 pid: 15620 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.893297:0:14353:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1790895598.893307:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 23 pid: 15620 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.893309:0:14353:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1790895598.893334:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d400/0x7911a98710cf9c43 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc319f expref: 23 pid: 15620 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.893351:0:14354:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:2.0:1790895598.893356:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.893364:0:14354:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.893370:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1790895598.893438:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201189c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+22:2362:x1877889741083776:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 176us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895598.893810:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:2.0:1790895598.893825:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1790895598.894038:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+21:2362:x1877889741083904:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1790895598.894056:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895598.894064:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 21 pid: 14367 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.894077:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 21 pid: 14367 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.894093:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55e00/0x7911a98710cf9c2e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc3198 expref: 21 pid: 14367 timeout: 571 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.894106:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:3.0:1790895598.894110:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.894119:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.894127:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895598.894156:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1790895598.894249:0:14368:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.894257:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895598.894273:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:2362:x1877889741083904:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 454us (1166us total) trans 0 rc 0/0 00000004:00200000:2.0:1790895598.894277:0:14368:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000100:00100000:3.0:1790895598.894283:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00010000:00010000:2.0:1790895598.894670:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91d600/0x7911a98710cf9c89 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31bb expref: 21 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.894688:0:14368:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91dc00/0x7911a98710cf9c90 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31bb expref: 20 pid: 14368 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.894694:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:2.0:1790895598.894697:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1790895598.894699:0:14368:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf33f91dc00, rc 0) 00000100:00100000:2.0:1790895598.894725:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:14476:x1877889741083648:12345-192.168.201.54@tcp:101:dd.0 Request processed in 12764us (13085us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1790895598.894731:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 34 00000100:00100000:0.0:1790895598.908466:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.908604:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741084160 00000100:00100000:1.0:1790895598.908616:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741084160 00000100:00100000:1.0:1790895598.908681:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 35 00000100:00100000:1.0:1790895598.908692:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:14476:x1877889741084160:12345-192.168.201.54@tcp:36:dd.0 00010000:00010000:1.0:1790895598.909012:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.909030:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.909041:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1790895598.909090:0:14369:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1790895598.909134:0:14369:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b33e970 reply state 000000007aec580e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895598.909143:0:14369:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895598.909997:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14476:x1877889741084160:12345-192.168.201.54@tcp:36:dd.0 Request processed in 1303us (1538us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1790895598.910004:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 35 00000020:00080000:1.0:1790895598.910010:0:14369:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790895598.914853:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.914900:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.914907:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.914914:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895598.914919:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.914926:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.914943:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:0.0:1790895598.914946:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895598.914951:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.914958:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55600/0x7911a98710cf9c9e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895598.919524:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.919821:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741084288 00000100:00100000:2.0:1790895598.919835:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741084288 00000100:00100000:2.0:1790895598.919927:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:2.0:1790895598.919938:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+22:14476:x1877889741084288:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:2.0:1790895598.919961:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895598.919982:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9ca5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31c2 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.920063:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c2 expref: 23 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.920079:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9ca5 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c2 expref: 23 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.920100:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:2.0:1790895598.920103:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1790895598.920106:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685600, rc 0) 00000100:00100000:2.0:1790895598.920167:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14476:x1877889741084288:12345-192.168.201.54@tcp:101:dd.0 Request processed in 230us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895598.920185:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 36 00000100:00100000:2.0:1790895598.946394:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895598.946711:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741084544 00000100:00100000:0.0:1790895598.946723:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741084544 00000100:00100000:0.0:1790895598.946810:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:0.0:1790895598.946822:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14476:x1877889741084544:12345-192.168.201.54@tcp:103:dd.0 00010000:00010000:0.0:1790895598.946898:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895598.946925:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685600/0x7911a98710cf9ca5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c2 expref: 23 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895598.946947:0:14353:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:0.0:1790895598.946953:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895598.947020:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+22:14476:x1877889741084544:12345-192.168.201.54@tcp:103:dd.0 Request processed in 188us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895598.947029:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:0.0:1790895598.960151:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895598.967082:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741084672 00000100:00100000:2.0:1790895598.967097:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741084672 00000100:00100000:2.0:1790895598.967165:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:2.0:1790895598.967183:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+22:14476:x1877889741084672:12345-192.168.201.54@tcp:58:dd.0 00010000:00010000:2.0:1790895598.967614:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.967632:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895598.967644:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1790895598.969796:0:15620:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1790895598.971139:0:15620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1790895598.971391:0:15620:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1790895598.972805:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+22:14476:x1877889741084672:12345-192.168.201.54@tcp:58:dd.0 Request processed in 5615us (12654us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895598.972819:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 37 00000100:00100000:2.0:1790895598.980615:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895598.980761:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741084800 00000100:00100000:1.0:1790895598.980782:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741084800 00000100:00100000:1.0:1790895598.980847:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 38 00000100:00100000:1.0:1790895598.980903:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+22:14476:x1877889741084800:12345-192.168.201.54@tcp:101:dd.0 00010000:00010000:1.0:1790895598.980928:0:14367:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895598.980950:0:14367:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31c9 expref: -99 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.981022:0:14367:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.981034:0:14367:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c9 expref: 23 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.981054:0:14367:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.981068:0:14367:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c9 expref: 23 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.981080:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:1.0:1790895598.981096:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790895598.981101:0:14367:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c9 expref: 23 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895598.981108:0:14367:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a54800, rc 0) 00000100:00100000:1.0:1790895598.981157:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14476:x1877889741084800:12345-192.168.201.54@tcp:101:dd.0 Request processed in 301us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895598.981165:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 38 00010000:00010000:3.0:1790895599.385257:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1790895599.640166:0:14398:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1790895599.640176:0:14398:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1790895599.640236:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1790895599.640243:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1790895599.640361:0:14398:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14398:1877889758893184:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1790895599.640463:0:14398:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1790895599.643603:0:14398:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14398:1877889758893184:192.168.201.54@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1790895599.646279:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.646499:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741084928 00000100:00100000:1.0:1790895599.646511:0:14378:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741084928 00000100:00100000:1.0:1790895599.646574:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:1.0:1790895599.646585:0:14378:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14477:x1877889741084928:12345-192.168.201.54@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1790895599.646666:0:14378:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14477:x1877889741084928:12345-192.168.201.54@tcp:900:lhsmtool_posix.0 Request processed in 83us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.646673:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:2.0:1790895599.652772:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.652976:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741085056 00000100:00100000:1.0:1790895599.652987:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741085056 00000100:00100000:1.0:1790895599.653060:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:1.0:1790895599.653073:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14477:x1877889741085056:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790895599.653116:0:14369:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790895599.653246:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14477:x1877889741085056:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 176us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.654927:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 39 00000100:00100000:0.0:1790895599.664328:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.664421:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741085184 00000100:00100000:1.0:1790895599.664431:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741085184 00000100:00100000:1.0:1790895599.664504:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:1.0:1790895599.664514:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14477:x1877889741085184:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1790895599.664581:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664597:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664611:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664644:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664652:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664657:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664679:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664687:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664693:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895599.664729:0:14367:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1790895599.664734:0:14367:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895599.664748:0:14367:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664773:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664779:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664787:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664793:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895599.664797:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664813:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664828:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf3183e2600) 00010000:00010000:1.0:1790895599.664832:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895599.664838:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664844:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9cba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664976:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664984:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.664990:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665010:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54a00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895599.665014:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665019:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665027:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8cf318c52c00) 00010000:00010000:1.0:1790895599.665029:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895599.665032:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665037:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9cc1 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665051:0:14367:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665057:0:14367:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665063:0:14367:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665068:0:14367:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54600 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:1.0:1790895599.665071:0:14367:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665077:0:14367:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665096:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:1.0:1790895599.665099:0:14367:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1790895599.665103:0:14367:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.665108:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54600/0x7911a98710cf9cc8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895599.665179:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14477:x1877889741085184:12345-192.168.201.54@tcp:34:lhsmtool_posix.0 Request processed in 666us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.665188:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 40 00000100:00100000:0.0:1790895599.669181:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895599.669280:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741085440 00000100:00100000:2.0:1790895599.669290:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741085440 00000100:00100000:2.0:1790895599.669356:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:2.0:1790895599.669365:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+23:14477:x1877889741085440:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895599.669386:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895599.669405:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9ccf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31d0 expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.669493:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.669509:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670053:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1790895599.670089:0:15620:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1790895599.670209:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670218:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670223:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670229:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337684c00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:2.0:1790895599.670233:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670251:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670263:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:2.0:1790895599.670267:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1790895599.670272:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670278:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9cd6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670329:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9ccf lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31d0 expref: 25 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670339:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8cf3183e2600) 00010000:00010000:2.0:1790895599.670342:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1790895599.670351:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9ccf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31d0 expref: 25 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.670361:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337685c00, rc 0) 00000100:00100000:2.0:1790895599.670464:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+24:14477:x1877889741085440:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 1099us (1292us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1790895599.670472:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 41 00000100:00100000:2.0:1790895599.681377:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.681502:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741085568 00000100:00100000:1.0:1790895599.681514:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741085568 00000100:00100000:1.0:1790895599.681609:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:1.0:1790895599.681620:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+24:14477:x1877889741085568:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1790895599.681680:0:14367:0:(mdt_handler.c:7976:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1790895599.682016:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+24:14477:x1877889741085568:12345-192.168.201.54@tcp:53:lhsmtool_posix.0 Request processed in 396us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.682024:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 42 00000100:00100000:0.0:1790895599.689633:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.689734:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741085824 00000100:00100000:1.0:1790895599.689744:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741085824 00000100:00100000:1.0:1790895599.689853:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:1.0:1790895599.689882:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+24:14477:x1877889741085824:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895599.689905:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895599.689925:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9ce4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31d7 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1790895599.696789:0:14369:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1790895599.696801:0:14369:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1790895599.696920:0:14369:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1790895599.700808:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ce00/0x7911a98710cf9ceb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.701386:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ce00/0x7911a98710cf9ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.701405:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ce00/0x7911a98710cf9ceb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.703183:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54a00/0x7911a98710cf9ce4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31d7 expref: 27 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.703210:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ce00/0x7911a98710cf9ceb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31d7 expref: 26 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.703220:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:1.0:1790895599.703223:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1790895599.703227:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7ce00, rc 0) 00000100:00100000:1.0:1790895599.703416:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+26:14477:x1877889741085824:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 13535us (13793us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1790895599.703426:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 43 00000100:00100000:0.0:1790895599.708421:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895599.708501:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741086080 00000100:00100000:3.0:1790895599.708511:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741086080 00000100:00100000:3.0:1790895599.708609:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:3.0:1790895599.708620:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+26:14477:x1877889741086080:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790895599.708701:0:14368:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895599.708730:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ce00/0x7911a98710cf9ceb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31d7 expref: 26 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708750:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037cd00) 00010000:00010000:3.0:1790895599.708768:0:14368:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895599.708791:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708805:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708814:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708888:0:14368:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708897:0:14368:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708905:0:14368:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708979:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.708986:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.711946:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.711981:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c000 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895599.711986:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712064:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712083:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8cf33290b500) 00010000:00010000:3.0:1790895599.712086:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895599.712091:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712098:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9cf9 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712117:0:14368:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712124:0:14368:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712130:0:14368:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712136:0:14368:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895599.712139:0:14368:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712144:0:14368:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712164:0:14368:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x402e6f17 (ffff8cf3183e2400) 00010000:00010000:3.0:1790895599.712166:0:14368:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895599.712169:0:14368:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.712175:0:14368:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d00 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x402e6f17 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14368 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895599.712285:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3397f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+25:14477:x1877889741086080:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 3664us (3870us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790895599.712294:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 44 00000100:00100000:2.0:1790895599.724842:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895599.725105:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741086208 00000100:00100000:0.0:1790895599.725117:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741086208 00000100:00100000:0.0:1790895599.725196:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:0.0:1790895599.725207:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+25:14477:x1877889741086208:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1790895599.725228:0:15620:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790895599.725372:0:15620:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d000/0x7911a98710cf9d07 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31de expref: -99 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.725407:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c000/0x7911a98710cf9d0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.725419:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c000/0x7911a98710cf9d0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.725431:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c000/0x7911a98710cf9d0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.725525:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7d000/0x7911a98710cf9d07 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31de expref: 27 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.725544:0:15620:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7c000/0x7911a98710cf9d0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31de expref: 26 pid: 15620 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.725552:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:0.0:1790895599.725555:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895599.725558:0:15620:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf31fe7c000, rc 0) 00000100:00100000:0.0:1790895599.725623:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+26:14477:x1877889741086208:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 418us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895599.725630:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 45 00000100:00100000:0.0:1790895599.728645:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.729125:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741086464 00000100:00100000:1.0:1790895599.729135:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741086464 00000100:00100000:1.0:1790895599.729192:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:1.0:1790895599.729202:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+26:14477:x1877889741086464:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1790895599.729291:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.729308:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.729319:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1790895599.730134:0:14367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:1.0:1790895599.730148:0:14367:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 472697289143ns, next at 473697286055ns, rc = 0 00000004:00010000:1.0:1790895599.730249:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f7fbf50 reply state 00000000a19b360d transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895599.730260:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1790895599.730363:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+28:14477:x1877889741086464:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 1161us (1726us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1790895599.730371:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 46 00000100:00100000:2.0:1790895599.733572:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.734113:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741086592 00000100:00100000:1.0:1790895599.734125:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741086592 00000100:00100000:1.0:1790895599.734190:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 47 00000100:00100000:1.0:1790895599.734201:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+28:14477:x1877889741086592:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895599.734226:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895599.734257:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31e5 expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.734328:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 29 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.734346:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 29 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.734367:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:1.0:1790895599.734370:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1790895599.734374:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a54e00, rc 0) 00000100:00100000:1.0:1790895599.734441:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+29:14477:x1877889741086592:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 242us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.734449:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 47 00010000:00010000:0.0:1790895599.737405:0:3294:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.737437:0:3294:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.737445:0:3294:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.737452:0:3294:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895599.737456:0:3294:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.737464:0:3294:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.737480:0:3294:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:0.0:1790895599.737484:0:3294:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1790895599.737489:0:3294:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.737496:0:3294:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54200/0x7911a98710cf9d15 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895599.737656:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895599.737735:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741086720 00000100:00100000:3.0:1790895599.737745:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741086720 00000100:00080000:0.0:1790895599.738016:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1790895599.738146:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:3.0:1790895599.738160:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2364:x1877889741086720:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1790895599.738501:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2364:x1877889741086720:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 344us (847us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1790895599.747411:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 12 00000100:00100000:0.0:1790895599.748419:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.748649:0:16589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741086976 00000100:00100000:1.0:1790895599.748660:0:16589:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741086976 00000100:00100000:1.0:1790895599.748719:0:16589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:1.0:1790895599.748730:0:16589:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+28:14477:x1877889741086976:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1790895599.749156:0:16589:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+29:14477:x1877889741086976:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 427us (740us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1790895599.749165:0:16589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 9 00000100:00100000:0.0:1790895599.754280:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895599.754440:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741087232 00000100:00100000:3.0:1790895599.754450:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741087232 00000100:00100000:3.0:1790895599.754505:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:3.0:1790895599.754515:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+29:14477:x1877889741087232:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790895599.754622:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+29:14477:x1877889741087232:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 108us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895599.754630:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 48 00000100:00100000:0.0:1790895599.767595:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.767676:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741087360 00000100:00100000:1.0:1790895599.767685:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741087360 00000100:00100000:1.0:1790895599.767737:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:1.0:1790895599.767746:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+29:14477:x1877889741087360:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895599.767777:0:14369:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895599.767799:0:14369:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55200/0x7911a98710cf9d23 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31ec expref: -99 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.767938:0:14369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54400/0x7911a98710cf9d2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.767953:0:14369:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54400/0x7911a98710cf9d2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.767964:0:14369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54400/0x7911a98710cf9d2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1790895599.768010:0:14369:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1790895599.768029:0:14369:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54400/0x7911a98710cf9d2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14369 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.768053:0:14369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a55200/0x7911a98710cf9d23 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31ec expref: 31 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.768076:0:14369:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54400/0x7911a98710cf9d2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31ec expref: 30 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.768085:0:14369:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:1.0:1790895599.768088:0:14369:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1790895599.768091:0:14369:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a54400, rc 0) 00000100:00100000:1.0:1790895599.768139:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+30:14477:x1877889741087360:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 394us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.768146:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 49 00000100:00100000:0.0:1790895599.774522:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895599.774736:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741087488 00000100:00100000:2.0:1790895599.774745:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741087488 00000100:00100000:2.0:1790895599.774901:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:2.0:1790895599.774913:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf34065b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+6:2362:x1877889741087488:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1790895599.774931:0:15049:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790895599.774953:0:15049:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31f3 expref: -99 pid: 15049 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895599.774994:0:15049:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6abee5f0, blocks: 0x1 00010000:00010000:2.0:1790895599.775020:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=472s v=(0 0) 00010000:00010000:2.0:1790895599.775025:0:15049:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895599.775034:0:15049:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 7 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.775054:0:15049:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 7 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.775089:0:15049:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf337684800, rc 0) 00000100:00100000:2.0:1790895599.775143:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf34065b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2362:x1877889741087488:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 232us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895599.775150:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:0.0:1790895599.778923:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895599.779055:0:14368:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741087744 00000100:00100000:3.0:1790895599.779078:0:14368:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741087744 00000100:00100000:3.0:1790895599.779168:0:14368:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:3.0:1790895599.779179:0:14368:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+30:14477:x1877889741087744:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1790895599.779270:0:14368:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+30:14477:x1877889741087744:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 95us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895599.779276:0:14368:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 50 00000100:00100000:0.0:1790895599.780855:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.780934:0:14369:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741087872 00000100:00100000:1.0:1790895599.780956:0:14369:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741087872 00000100:00100000:1.0:1790895599.781005:0:14369:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 51 00000100:00100000:1.0:1790895599.781015:0:14369:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+30:14477:x1877889741087872:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1790895599.829830:0:14369:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+30:14477:x1877889741087872:12345-192.168.201.54@tcp:44:lhsmtool_posix.0 Request processed in 48803us (48965us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.829847:0:14369:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 51 00000001:00080000:0.0:1790895599.829950:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934603 is committed 00000001:00080000:0.0:1790895599.829961:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:0.0:1790895599.829982:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1790895599.829988:0:5854:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1790895599.830035:0:5854:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1790895599.830196:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1790895599.830213:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758893312:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1790895599.830277:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895599.830345:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758893312 00000100:00100000:1.0:1790895599.830353:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758893312 00000100:00100000:1.0:1790895599.830393:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790895599.830403:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758893312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1790895599.830766:0:15052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790895599.830771:0:15052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1790895599.830781:0:15052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1790895599.830783:0:15052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790895600 -> 1790895600 00002000:00010000:1.0:1790895599.830785:0:15052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790895599.830831:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1877889758893312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 429us (553us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1790895599.830838:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1790895599.830947:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8cf201181880/2, rc 0, transno 8589934595 00000100:00100000:0.0:1790895599.830953:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758893312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1790895599.834734:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895599.834836:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741088000 00000100:00100000:2.0:1790895599.834847:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741088000 00000100:00100000:2.0:1790895599.834975:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:2.0:1790895599.834986:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2361:x1877889741088000:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1790895599.835201:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2361:x1877889741088000:12345-192.168.201.54@tcp:16:lhsmtool_posix.0 Request processed in 217us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895599.835210:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:2.0:1790895599.838593:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895599.838676:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741088256 00000100:00100000:3.0:1790895599.838686:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741088256 00000100:00100000:3.0:1790895599.838772:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 52 00000100:00100000:3.0:1790895599.838784:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+14:14477:x1877889741088256:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1790895599.838843:0:14367:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1790895599.838888:0:14367:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54400/0x7911a98710cf9d2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31ec expref: 14 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.838908:0:14367:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:3.0:1790895599.838914:0:14367:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790895599.838944:0:14367:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.838958:0:14367:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.838968:0:14367:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1790895599.839302:0:14367:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2d78dc0 reply state 0000000070b3042b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895599.839312:0:14367:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1790895599.839419:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+15:14477:x1877889741088256:12345-192.168.201.54@tcp:36:lhsmtool_posix.0 Request processed in 637us (834us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1790895599.839427:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 52 00010000:00010000:3.0:1790895599.842627:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.842646:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.842654:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.842661:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:3.0:1790895599.842666:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.842673:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.842689:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:3.0:1790895599.842692:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1790895599.842697:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.842703:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91ce00/0x7911a98710cf9d38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14367 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895599.843726:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.843923:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741088384 00000100:00100000:1.0:1790895599.843934:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741088384 00000100:00100000:1.0:1790895599.843997:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:1.0:1790895599.844008:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:14477:x1877889741088384:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1790895599.844025:0:15051:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790895599.844042:0:15051:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x8300040986fc31fa expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.844072:0:15051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 8 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.844082:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895599.844086:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895599.844092:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 8 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.844126:0:15051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 8 pid: 15049 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.844141:0:15051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 8 pid: 15049 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895599.844188:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15051:1877889758893440:192.168.201.54@tcp:104: 00000100:00100000:1.0:1790895599.844291:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31bbcdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1790895599.847724:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15051:1877889758893440:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895599.847769:0:15051:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 8 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.847790:0:15051:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8cf340a55200, rc 0) 00000100:00100000:2.0:1790895599.847850:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+8:14477:x1877889741088384:12345-192.168.201.54@tcp:101:lhsmtool_posix.0 Request processed in 3843us (4130us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895599.847893:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 16 00000100:00100000:0.0:1790895599.850625:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.850892:0:14354:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741088512 00000100:00100000:1.0:1790895599.850903:0:14354:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741088512 00010000:00010000:1.0:1790895599.851045:0:14354:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 8 pid: 15049 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895599.851088:0:14354:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:1.0:1790895599.851099:0:14354:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+8:2361:x1877889741088512:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895599.851114:0:14354:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895599.851136:0:14354:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 8 pid: 15049 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.851150:0:14354:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 8 pid: 15049 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.851324:0:14354:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008af6f455/0x7911a98710cf9d31 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31f3 expref: 8 pid: 15049 timeout: 572 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.851341:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895599.851346:0:14354:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895599.851352:0:14354:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 7 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.851382:0:14354:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 7 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.851418:0:14354:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 7 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895599.851432:0:14354:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14354:1877889758893568:192.168.201.54@tcp:105: 00000100:00100000:1.0:1790895599.851642:0:14354:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf31bbcdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1790895599.856375:0:14354:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14354:1877889758893568:192.168.201.54@tcp:105: 00010000:00010000:1.0:1790895599.856405:0:14354:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895599.856475:0:14354:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2361:x1877889741088512:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 5377us (5857us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.856485:0:14354:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:2.0:1790895599.859923:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.860018:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741088640 00000100:00100000:1.0:1790895599.860027:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741088640 00000100:00100000:1.0:1790895599.860084:0:15052:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:1.0:1790895599.860095:0:15052:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2361:x1877889741088640:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1790895599.860711:0:15052:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1790895599.860716:0:15052:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1790895599 00002000:00010000:1.0:1790895599.860719:0:15052:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1790895598 00002000:00010000:1.0:1790895599.860722:0:15052:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1790895600 -> 1790895599 00002000:00010000:1.0:1790895599.860724:0:15052:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1790895599.860803:0:15052:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+8:2361:x1877889741088640:12345-192.168.201.54@tcp:2:lhsmtool_posix.0 Request processed in 709us (900us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1790895599.860825:0:15052:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 17 00000100:00100000:0.0:1790895599.864655:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895599.864838:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741088768 00000100:00100000:2.0:1790895599.864848:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741088768 00000100:00100000:2.0:1790895599.864959:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:2.0:1790895599.864970:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+8:2362:x1877889741088768:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1790895599.865215:0:15051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.865238:0:15051:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 8 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.865257:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895599.865262:0:15051:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1790895599.865267:0:15051:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.865302:0:15051:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 8 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.865317:0:15051:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 8 pid: 15051 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895599.865331:0:15051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15051:1877889758893696:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895599.865426:0:15051:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1790895599.868303:0:15051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15051:1877889758893696:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895599.868335:0:15051:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895599.871014:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895599.871106:0:14353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741088896 00000100:00100000:1.0:1790895599.871116:0:14353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741088896 00010000:00010000:1.0:1790895599.871166:0:14353:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 9 pid: 15051 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895599.871211:0:14353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:1.0:1790895599.871220:0:14353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:2362:x1877889741088896:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1790895599.871235:0:14353:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790895599.871267:0:14353:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 9 pid: 15051 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.871281:0:14353:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 9 pid: 15051 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.871305:0:14353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31fa expref: 9 pid: 15051 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.871321:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790895599.871325:0:14353:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1790895599.871331:0:14353:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.871341:0:14353:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895599.871393:0:14353:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1790895599.871461:0:14353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+8:2362:x1877889741088896:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 241us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.871468:0:14353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00010000:00010000:2.0:1790895599.872039:0:15051:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872051:0:15051:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872076:0:15051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872085:0:15051:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872094:0:15051:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872101:0:15051:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685400 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895599.872105:0:15051:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872115:0:15051:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872127:0:15051:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.872147:0:15051:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b496d17/0x7911a98710cf9d46 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895599.872223:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2362:x1877889741088768:12345-192.168.201.54@tcp:1:lhsmtool_posix.0 Request processed in 7255us (7577us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895599.872231:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 18 00000100:00100000:0.0:1790895599.877473:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895599.877615:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741089152 00000100:00100000:2.0:1790895599.877627:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741089152 00000100:00100000:2.0:1790895599.877689:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 53 00000100:00100000:2.0:1790895599.877701:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+14:14477:x1877889741089152:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1790895599.877810:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.877829:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.877842:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.878123:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.878135:0:15620:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.878144:0:15620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.878196:0:15620:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 15 pid: 14369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.878209:0:15620:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 15 pid: 14369 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895599.878223:0:15620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15620:1877889758893824:192.168.201.54@tcp:104: 00000100:00100000:2.0:1790895599.878313:0:15620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf33908ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1790895599.881226:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895599.881319:0:15620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15620:1877889758893824:192.168.201.54@tcp:104: 00010000:00010000:2.0:1790895599.881345:0:15620:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895599.881438:0:14352:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741089280 00000100:00100000:0.0:1790895599.881445:0:14352:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741089280 00010000:00010000:0.0:1790895599.881487:0:14352:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 16 pid: 14369 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895599.881519:0:14352:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:0.0:1790895599.881527:0:14352:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+16:2361:x1877889741089280:12345-192.168.201.54@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1790895599.881541:0:14352:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1790895599.881547:0:14352:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 16 pid: 14369 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.881558:0:14352:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 16 pid: 14369 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.881577:0:14352:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54e00/0x7911a98710cf9d1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.54@tcp remote: 0x8300040986fc31e5 expref: 16 pid: 14369 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.881608:0:14352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:0.0:1790895599.881612:0:14352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.881621:0:14352:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.881629:0:14352:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.881652:0:14352:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1790895599.881697:0:14352:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+15:2361:x1877889741089280:12345-192.168.201.54@tcp:103:ldlm_bl.0 Request processed in 169us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895599.881704:0:14352:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00010000:00010000:2.0:1790895599.881843:0:15620:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895599.881851:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1790895599.882067:0:15620:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1790895599.882210:0:15620:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1790895599.882272:0:15620:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1790895599.882348:0:15620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15620:1877889758893952:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1790895599.882430:0:15620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895599.882469:0:15620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf305932600 going to sleep for 11 seconds 00000100:00100000:1.0:1790895599.882604:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758893952 00000100:00100000:1.0:1790895599.882609:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758893952 00000100:00100000:1.0:1790895599.882645:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790895599.882653:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15620:x1877889758893952:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790895599.882717:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15620:x1877889758893952:12345-0@lo:1000:mdt00_003.0 Request processed in 65us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895599.882724:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790895599.883490:0:15620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf3060c3100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15620:1877889758893952:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1790895599.884624:0:15620:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1790895599.884703:0:15620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15620:1877889758894080:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1790895599.884770:0:15620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790895599.884838:0:15620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3060efe40 going to sleep for 11 seconds 00000100:00100000:1.0:1790895599.886349:0:14372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758894080 00000100:00100000:1.0:1790895599.886362:0:14372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758894080 00000100:00100000:1.0:1790895599.886459:0:14372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1790895599.886469:0:14372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15620:x1877889758894080:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1790895599.886680:0:14372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:15620:x1877889758894080:12345-0@lo:1000:mdt00_003.0 Request processed in 212us (1909us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1790895599.886687:0:14372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1790895599.886877:0:15620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e35f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15620:1877889758894080:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1790895599.886916:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.886927:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.886935:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.886953:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685c00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895599.886958:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.886967:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.886984:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:0.0:1790895599.886987:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895599.887006:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887012:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685c00/0x7911a98710cf9d54 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887044:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887051:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887057:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887062:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685200 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895599.887064:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887069:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887087:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:0.0:1790895599.887089:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1790895599.887096:0:15620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c9 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887107:0:15620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c9 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887116:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c9 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.887181:0:15620:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8cf340a54800/0x7911a98710cf9cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.54@tcp remote: 0x8300040986fc31c9 expref: 18 pid: 14367 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895599.887195:0:15620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf318e37100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15620:1877889758894208:192.168.201.54@tcp:105: 00000100:00100000:0.0:1790895599.887276:0:15620:0:(client.c:2716:ptlrpc_set_wait()) set ffff8cf3060ef000 going to sleep for 11 seconds 00000100:00100000:0.0:1790895599.890433:0:15620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf318e37100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15620:1877889758894208:192.168.201.54@tcp:105: 00010000:00010000:0.0:1790895599.890476:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890488:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337685200/0x7911a98710cf9cac lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890537:0:15620:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890550:0:15620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890575:0:15620:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890588:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890594:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890600:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890606:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7ca00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895599.890610:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890617:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890627:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:0.0:1790895599.890630:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1790895599.890634:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890639:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf31fe7ca00/0x7911a98710cf9d5b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890649:0:15620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890655:0:15620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890668:0:15620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890672:0:15620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337684c00 already unused, calling callback (ffffffffc1e9d4f0) 00010000:00010000:0.0:1790895599.890675:0:15620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890681:0:15620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890689:0:15620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8cf318c52800) 00010000:00010000:0.0:1790895599.890703:0:15620:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1790895599.890706:0:15620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.890712:0:15620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf337684c00/0x7911a98710cf9d4d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15620 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895599.890962:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:14477:x1877889741089152:12345-192.168.201.54@tcp:57:lhsmtool_posix.0 Request processed in 13262us (13508us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1790895599.890972:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 53 00000020:00080000:0.0:1790895599.890978:0:15620:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1790895599.896665:0:14398:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1790895599.896675:0:14398:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1790895599.896723:0:14398:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1790895599.896729:0:14398:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1790895599.898388:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895599.898443:0:14370:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741089408 00000100:00100000:0.0:1790895599.898454:0:14370:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741089408 00000100:00100000:0.0:1790895599.898503:0:14370:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:0.0:1790895599.898514:0:14370:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf337ceec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:14476:x1877889741089408:12345-192.168.201.54@tcp:49:dd.0 00000100:00100000:0.0:1790895599.898643:0:14370:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf337ceec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:14476:x1877889741089408:12345-192.168.201.54@tcp:49:dd.0 Request processed in 130us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895599.898660:0:14370:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 10 00000100:00100000:3.0:1790895599.899260:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895599.899333:0:14371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741089664 00000100:00100000:3.0:1790895599.899338:0:14371:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741089664 00000100:00100000:3.0:1790895599.899364:0:14371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 11 00000100:00100000:3.0:1790895599.899372:0:14371:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+18:14477:x1877889741089664:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1790895599.907114:0:14371:0:(mdd_object.c:4178:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1790895599.907238:0:14371:0:(tgt_lastrcvd.c:2120:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1790895599.907318:0:14371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.907337:0:14371:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.907350:0:14371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.907359:0:14371:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.907365:0:14371:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.907372:0:14371:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895599.907404:0:14371:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1790895599.907479:0:14356:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1790895599.907486:0:14356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.907492:0:14356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91c000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895599.907496:0:14356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.907504:0:14356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895599.907513:0:14371:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+20:14477:x1877889741089664:12345-192.168.201.54@tcp:35:lhsmtool_posix.0 Request processed in 8138us (8251us total) trans 8589934622 rc 0/0 00010000:00010000:0.0:1790895599.907517:0:14356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8cf31037ca00) 00010000:00010000:0.0:1790895599.907520:0:14356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00000100:00100000:3.0:1790895599.907523:0:14371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 11 00010000:00010000:0.0:1790895599.907524:0:14356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1790895599.907528:0:14371:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1790895599.907530:0:14356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8cf33f91c000/0x7911a98710cf9d62 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14371 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895599.907542:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895599.907543:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790895599.907545:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1790895600.055487:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895600.055534:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895600.055637:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741089792 00000100:00100000:1.0:1790895600.055647:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741089792 00000100:00100000:1.0:1790895600.055711:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741089920 00000100:00100000:1.0:1790895600.055715:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741089920 00000100:00100000:1.0:1790895600.055737:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:1.0:1790895600.055747:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf318e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+8:2364:x1877889741089792:12345-192.168.201.54@tcp:4:dd.0 00002000:00010000:1.0:1790895600.055803:0:15056:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6abee5ef, atime: 0x6abee5ee, ctime: 0x6abee5ef, blocks: 0x1 00010000:00010000:1.0:1790895600.055818:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.055834:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=473s v=(0 0) 00010000:00010000:1.0:1790895600.055839:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895600.055846:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.055888:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895600.061923:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895600.062436:0:15055:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1790895600.062455:0:15055:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1790895600.063091:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090048 00000100:00100000:2.0:1790895600.063102:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090048 00000100:00100000:3.0:1790895600.063581:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 1 00000100:00100000:3.0:1790895600.063593:0:16591:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3369e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+10:2364:x1877889741089920:12345-192.168.201.54@tcp:4:dd.0 00010000:00010000:3.0:1790895600.063628:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895600.063646:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895600.063650:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1790895600.063657:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790895600.063672:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895600.089020:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758894720:0@lo:400:kworker.0 00000100:00100000:1.0:1790895600.089090:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895600.089156:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1790895600.089163:0:3309:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758894592:0@lo:400:kworker.0 00000100:00100000:1.0:1790895600.089187:0:3309:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790895600.089224:0:14367:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758894720 00000100:00100000:1.0:1790895600.089231:0:14367:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758894720 00000100:00100000:1.0:1790895600.089287:0:14367:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790895600.089296:0:14367:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758894720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895600.089345:0:14367:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1877889758894720:12345-0@lo:400:kworker.0 Request processed in 49us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895600.089352:0:14367:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1790895600.089375:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758894592 00000100:00100000:1.0:1790895600.089378:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758894592 00000100:00100000:1.0:1790895600.089410:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790895600.089416:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758894592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895600.089458:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1877889758894592:12345-0@lo:400:kworker.0 Request processed in 43us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895600.089464:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1790895600.089483:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1790895600.089509:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3309:1877889758894592:0@lo:400:kworker.0 00000100:00100000:1.0:1790895600.089533:0:3309:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3309:1877889758894720:0@lo:400:kworker.0 00000100:00100000:2.0:1790895600.089948:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758894464:0@lo:400:kworker.0 00000100:00100000:2.0:1790895600.089997:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895600.090019:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758894976:0@lo:400:kworker.0 00000100:00100000:2.0:1790895600.090038:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895600.090054:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1790895600.090059:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3311:1877889758894336:0@lo:400:kworker.0 00000100:00100000:2.0:1790895600.090083:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895600.090106:0:3311:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf201182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758894848:0@lo:400:kworker.0 00000100:00100000:2.0:1790895600.090125:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895600.090151:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758894464 00000100:00100000:2.0:1790895600.090156:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758894464 00000100:00100000:2.0:1790895600.090185:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895600.090192:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1877889758894464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1790895600.090226:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3311:x1877889758894464:12345-0@lo:400:kworker.0 Request processed in 36us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1790895600.090232:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1790895600.090358:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201180000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3311:1877889758894464:0@lo:400:kworker.0 00000100:00100000:0.0:1790895600.090475:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758894976 00000100:00100000:0.0:1790895600.090479:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758894976 00000100:00100000:0.0:1790895600.090502:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758894848 00000100:00100000:0.0:1790895600.090505:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758894848 00000100:00100000:0.0:1790895600.090533:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790895600.090539:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758894976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895600.090575:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1877889758894976:12345-0@lo:400:kworker.0 Request processed in 37us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895600.090581:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1790895600.090592:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1790895600.090598:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758894848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1790895600.090622:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3060c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1877889758894848:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895600.090627:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1790895600.090911:0:3308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8cf336be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758895104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1790895600.090941:0:3308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790895600.091080:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3311:1877889758894848:0@lo:400:kworker.0 00000100:00100000:2.0:1790895600.091091:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201182a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3311:1877889758894976:0@lo:400:kworker.0 00000100:00100000:1.0:1790895600.092329:0:14361:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758894336 00000100:00100000:1.0:1790895600.092339:0:14361:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758894336 00000100:00100000:1.0:1790895600.092391:0:14361:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1790895600.092401:0:14361:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3311:x1877889758894336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1790895600.092462:0:14361:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:38adfb21-dafb-4eb3-8476-02ed33ee7efa+19:3311:x1877889758894336:12345-0@lo:400:kworker.0 Request processed in 63us (2378us total) trans 0 rc 0/0 00000100:00100000:1.0:1790895600.092469:0:14361:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1790895600.092503:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1790895600.092509:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1790895600.092540:0:3311:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf201181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:38adfb21-dafb-4eb3-8476-02ed33ee7efa:3311:1877889758894336:0@lo:400:kworker.0 00000100:00100000:0.0:1790895600.093137:0:15053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889758895104 00000100:00100000:0.0:1790895600.093143:0:15053:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889758895104 00000100:00100000:0.0:1790895600.093178:0:15053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790895600.093186:0:15053:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758895104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1790895600.093216:0:15053:0:(ofd_obd.c:737:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1790895600.093331:0:15053:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1877889758895104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895600.093338:0:15053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1790895600.093374:0:3308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8cf336be5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3308:1877889758895104:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1790895600.224538:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:1.0:1790895600.224547:0:15056:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1790895599 -> 1790895600 00002000:00010000:1.0:1790895600.224550:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:1.0:1790895600.224563:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224576:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224585:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224606:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895600.224611:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224621:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224640:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224648:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000161458ff/0x7911a98710cf9d69 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895600.224725:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf318e37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+14:2364:x1877889741089792:12345-192.168.201.54@tcp:4:dd.0 Request processed in 168976us (169243us total) trans 8589934598 rc 0/0 00000100:00100000:1.0:1790895600.224735:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 0 00000100:00100000:1.0:1790895600.224778:0:15056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:1.0:1790895600.224799:0:15056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+13:2364:x1877889741090048:12345-192.168.201.54@tcp:4:dd.0 00010000:00010000:1.0:1790895600.224831:0:15056:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224843:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895600.224847:0:15056:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895600.224853:0:15056:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.224907:0:15056:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.229549:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.229569:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.229579:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.229598:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf33f91ce00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895600.229604:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.229614:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.229632:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.229640:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000063bb6153/0x7911a98710cf9d70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895600.229724:0:16591:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3369e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+13:2364:x1877889741089920:12345-192.168.201.54@tcp:4:dd.0 Request processed in 166129us (174185us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1790895600.229737:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 1 00000001:00080000:2.0:1790895600.229781:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1790895600.229792:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:2.0:1790895600.229802:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1790895600.279384:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:1.0:1790895600.279470:0:15056:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1790895600.279475:0:15056:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1790895600.279488:0:15056:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.279502:0:15056:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.279512:0:15056:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.279518:0:15056:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a54a00 already unused, calling callback (ffffffffc142b900) 00010000:00010000:1.0:1790895600.279523:0:15056:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.279532:0:15056:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.279551:0:15056:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.279558:0:15056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087a2cb84/0x7911a98710cf9d77 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15056 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895600.279658:0:15056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf340658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2364:x1877889741090048:12345-192.168.201.54@tcp:4:dd.0 Request processed in 54858us (217741us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1790895600.279669:0:15056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 2 00000100:00100000:1.0:1790895600.283279:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:0.0:1790895600.284116:0:15055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090176 00000100:00100000:0.0:1790895600.284130:0:15055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090176 00000100:00100000:0.0:1790895600.284213:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:0.0:1790895600.284224:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2363:x1877889741090176:12345-192.168.201.54@tcp:4:dd.0 00002000:00010000:0.0:1790895600.284285:0:15055:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6abee5f0, atime: 0x6abee5ee, ctime: 0x0, blocks: 0x1807 00010000:00010000:0.0:1790895600.284295:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.284324:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=473s v=(0 0) 00010000:00010000:0.0:1790895600.284329:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895600.284336:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.284350:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790895600.291287:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895600.293905:0:16591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090304 00000100:00100000:2.0:1790895600.293920:0:16591:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090304 00000100:00100000:2.0:1790895600.293999:0:16591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 4 00000100:00100000:2.0:1790895600.294009:0:16591:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+7:2364:x1877889741090304:12345-192.168.201.54@tcp:4:dd.0 00010000:00010000:2.0:1790895600.294044:0:16591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.294077:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895600.294081:0:16591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895600.294087:0:16591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.294100:0:16591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790895600.297913:0:3302:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895600.297996:0:15057:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1790895600.298006:0:15057:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1790895600.306399:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895600.306427:0:3303:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895600.306824:0:15056:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1790895600.306838:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090560 00000100:00100000:2.0:1790895600.306847:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090560 00000100:00100000:2.0:1790895600.306941:0:15056:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1790895600.306947:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090432 00000100:00100000:2.0:1790895600.306950:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090432 00000100:00100000:2.0:1790895600.306962:0:15056:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1790895600.306967:0:15056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090688 00000100:00100000:2.0:1790895600.306970:0:15056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090688 00000100:00100000:1.0:1790895600.313036:0:16594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:1.0:1790895600.313057:0:16594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+13:2364:x1877889741090560:12345-192.168.201.54@tcp:4:dd.0 00010000:00010000:1.0:1790895600.313102:0:16594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.313122:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895600.313128:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1790895600.313136:0:16594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790895600.313150:0:16594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1790895600.371156:0:15055:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:2.0:1790895600.371166:0:15055:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1790895600 00002000:00010000:2.0:1790895600.371169:0:15055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1790895600.371184:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371198:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371208:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371248:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7c600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895600.371253:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371269:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371305:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371313:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3d950ae/0x7911a98710cf9d7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895600.371435:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+17:2363:x1877889741090176:12345-192.168.201.54@tcp:4:dd.0 Request processed in 87207us (88160us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1790895600.371446:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 3 00000100:00100000:2.0:1790895600.371483:0:15055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 6 00000100:00100000:2.0:1790895600.371495:0:15055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+16:2364:x1877889741090432:12345-192.168.201.54@tcp:4:dd.0 00010000:00010000:2.0:1790895600.371525:0:15055:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371538:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895600.371542:0:15055:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1790895600.371548:0:15055:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.371571:0:15055:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1790895600.376573:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00010000:00010000:3.0:1790895600.410286:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1790895600.432762:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:0.0:1790895600.433106:0:16594:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:0.0:1790895600.433123:0:16594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433137:0:16594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433146:0:16594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433154:0:16594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf340a55600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895600.433159:0:16594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433169:0:16594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433206:0:16594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433214:0:16594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b5f8053a/0x7911a98710cf9d8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895600.433311:0:16594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+12:2364:x1877889741090560:12345-192.168.201.54@tcp:4:dd.0 Request processed in 120256us (135402us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1790895600.433321:0:16594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 5 00000100:00100000:0.0:1790895600.433354:0:16594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:0.0:1790895600.433366:0:16594:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf307682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+11:2364:x1877889741090688:12345-192.168.201.54@tcp:4:dd.0 00010000:00010000:0.0:1790895600.433399:0:16594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433412:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895600.433416:0:16594:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1790895600.433422:0:16594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.433433:0:16594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.433843:0:16591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.433853:0:16591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.433889:0:16591:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.433896:0:16591:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685600 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895600.433900:0:16591:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.433907:0:16591:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.433918:0:16591:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.433926:0:16591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4a036f7/0x7911a98710cf9d85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895600.433967:0:16591:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201180380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+11:2364:x1877889741090304:12345-192.168.201.54@tcp:4:dd.0 Request processed in 139959us (142689us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1790895600.434079:0:16591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 4 00000001:00080000:1.0:1790895600.470020:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1790895600.476687:0:15055:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1790895600.476697:0:15055:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 16391 00010000:00010000:0.0:1790895600.476713:0:15055:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.476736:0:15055:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.476758:0:15055:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.476766:0:15055:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf337685200 already unused, calling callback (ffffffffc142b900) 00010000:00010000:0.0:1790895600.476772:0:15055:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.476783:0:15055:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.476805:0:15055:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790895600.476812:0:15055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076d5fc3/0x7911a98710cf9d93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1790895600.476930:0:15055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307683100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+9:2364:x1877889741090432:12345-192.168.201.54@tcp:4:dd.0 Request processed in 105433us (170537us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1790895600.476941:0:15055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 6 00000001:00080000:1.0:1790895600.506494:0:6715:0:(tgt_lastrcvd.c:984:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:2.0:1790895600.506833:0:16594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.506849:0:16594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.506885:0:16594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.506894:0:16594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8cf31fe7d000 already unused, calling callback (ffffffffc142b900) 00010000:00010000:2.0:1790895600.506899:0:16594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.506910:0:16594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.506931:0:16594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790895600.506938:0:16594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa89c3a9/0x7911a98710cf9d9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790895600.507101:0:16594:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf307682680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2364:x1877889741090688:12345-192.168.201.54@tcp:4:dd.0 Request processed in 73733us (200667us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1790895600.507113:0:16594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 7 00000100:00100000:1.0:1790895600.528021:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895600.528116:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895600.528149:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:1.0:1790895600.528199:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:3.0:1790895600.528257:0:15620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741091072 00000100:00100000:3.0:1790895600.528268:0:15620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741091072 00000100:00100000:3.0:1790895600.528335:0:15620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:3.0:1790895600.528345:0:15620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2361:x1877889741091072:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895600.528423:0:15620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:eea0ff28-2c65-417b-9501-307d7aea62a8+6:2361:x1877889741091072:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 79us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895600.528440:0:15620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 25 00000100:00100000:0.0:1790895600.528834:0:14359:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090816 00000100:00100000:0.0:1790895600.528839:0:14359:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090816 00000100:00100000:0.0:1790895600.528907:0:14359:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 120 00000100:00100000:0.0:1790895600.528915:0:14359:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+13:2361:x1877889741090816:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895600.528958:0:14359:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf3030f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:68072c20-598b-412d-9027-10e9da026c3e+13:2361:x1877889741090816:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 44us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895600.528964:0:14359:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 120 00000100:00080000:0.0:1790895600.530645:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1790895600.542193:0:3301:0:(events.c:344:request_in_callback()) peer: 12345-192.168.201.54@tcp (source: 12345-192.168.201.54@tcp) 00000100:00100000:2.0:1790895600.542273:0:15052:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741090944 00000100:00100000:2.0:1790895600.542284:0:15052:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741090944 00000100:00100000:3.0:1790895600.542389:0:15051:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741091200 00000100:00100000:3.0:1790895600.542394:0:15051:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741091200 00000100:00100000:3.0:1790895600.542437:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:3.0:1790895600.542446:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2362:x1877889741090944:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895600.542511:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a3a9f9f0-10b2-41f5-96b5-b7728332a4f3+5:2362:x1877889741090944:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 66us (14500us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895600.542519:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 13 00000100:00100000:3.0:1790895600.542537:0:15051:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00100000:3.0:1790895600.542543:0:15051:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2362:x1877889741091200:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:3.0:1790895600.542566:0:15051:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2362:x1877889741091200:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 23us (14367us total) trans 0 rc 0/0 00000100:00100000:3.0:1790895600.542572:0:15051:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 14 00000100:00080000:0.0:1790895600.543326:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1790895600.543333:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1790895600.550684:0:15049:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877889741091328 00000100:00100000:0.0:1790895600.550708:0:15049:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1877889741091328 00000100:00100000:0.0:1790895600.550801:0:15049:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00100000:0.0:1790895600.550811:0:15049:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff8cf201182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2361:x1877889741091328:12345-192.168.201.54@tcp:400:kworker.0 00000100:00100000:0.0:1790895600.550922:0:15049:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff8cf201182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:eea0ff28-2c65-417b-9501-307d7aea62a8+5:2361:x1877889741091328:12345-192.168.201.54@tcp:400:kworker.0 Request processed in 112us (8738us total) trans 0 rc 0/0 00000100:00100000:0.0:1790895600.550929:0:15049:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.54@tcp, seq: 15 00000100:00080000:1.0:1790895600.551804:0:14363:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1790895601.432260:0:14356:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1790895601.620529:0:16631:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1790895602.457025:0:14355:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29070 lines, 29070 kept, 0 dropped, 0 bad.